Connect with us

Technologies

Apple Vision Pro Hands-On: Far Better Than I Was Ready For

I experienced incredible fidelity, surprising video quality and a really smooth interface. Apple’s first mixed-reality headset nails those, but lots of questions remain.

I was in a movie theater last December watching Avatar: The Way of Water in 3D, and I said to myself: «Wow, this is an immersive film I’d love to watch in next-gen VR.» That’s exactly what I experienced in Apple’s Vision Pro headset, and yeah, it’s amazing.

On Monday, I tried out the Vision Pro in a series of carefully picked demos during WWDC at Apple’s Cupertino, California, headquarters. I’ve been using cutting-edge VR devices for years, and I found all sorts of augmented reality memories bubbling up in my brain. Apple’s compact — but still not small —headset reminds me of an Apple-designed Meta Quest Pro. The fit of the back strap was comfy yet stretchy, with a dial to adjust the rear fit and a top strap for stability. The headset’s sleek design, and even its glowing front faceplate, also gave me an instant Ready Player One vibe. 

vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png
Watch this: Apple Vision Pro: I Tried Apple’s AR/VR Headset

05:35

I couldn’t wear my glasses during the demo, though, and neither will you. Apple’s headset does not support glasses, instead relying on Zeiss custom inserts to correct wearers’ vision. Apple did manage, through a setup process, to easily find lenses that fit my vision well enough so that everything seemed crystal clear, which is not an easy task. Also, we adjusted the fit and tuned spatial audio for my head using an iPhone, a system that will be finessed when the headset is released in 2024.

From there, I did my demos seated, mostly, and found myself surprised from the start. The passthrough video camera quality of this headset is good —really, really good. Not as good as my own vision, but good enough that I could see the room well, see people in it with me, see my watch notifications easily on my wrist. The only headset that’s done this previously was the extremely impressive but PC-connected Varjo XR-3, and Apple’s display and cameras feel even better.

Apple’s floating grid of apps appears when I press the top digital crown, which autocenters the home screen to wherever I’m looking. I set up eye tracking, which worked like on many other VR headsets I’ve used: I looked at glowing dots as musical notes played, and got a chime when it all worked.

An app menu in Apple's VisionOS. An app menu in Apple's VisionOS.

A list of apps as they would appear inside of the Apple Vision Pro headset.

Apple/Screenshot by CNET

From there, the interface was surprisingly fluid. Looking at icons or interface options slightly enlarges them, or changes how bold they appear. Tapping with my fingers while looking at something opens an app. 

I’ve used tons of hand-tracking technology on headsets like the HoloLens 2 and the Meta Quest 2 and Pro, and usually there’s a lot of hand motion required. Here, I could be really lazy. I pinched to open icons even while my hand was resting in my lap, and it worked. 

Scrolling involves pinching and pulling with my fingers; again, pretty easy to do. I resized windows by moving my hand to throw a window across the room or pin it closer to me. I opened multiple apps at once, including Safari, Messages and Photos. It was easy enough to scroll around, although sometimes my eye tracking needed a bit of extra concentration to pull off.

Apple’s headset uses eye tracking constantly in its interface, something Meta’s Quest Pro and even the PlayStation VR 2 don’t do. That might be part of the reason for the external battery pack. The emphasis on eye tracking as a major part of the interface felt transformative, in a way I expected might be the case for VR and AR years ago. What I don’t know is how it will feel in longer sessions.

I don’t know how the Vision Pro will work with keyboards and trackpads, since I didn’t get to demo the headset that way. It works with Apple’s Magic Keyboard and Magic Trackpad, and Macs, but not with iPhone and iPad or Watch touchscreens —not now, at least.

Dialing in reality

I scrolled through some photos in Apple’s preset photo album, plus a few 3D photos and video clips shot with the Vision Pro’s 3D camera. All the images looked really crisp, and a panoramic photo that spread around me looked almost like it was a window on a landscape that extended just beyond the room I was in. 

Apple has volumetric 3D landscapes on the Vision Pro that are immersive backgrounds like 3D wallpaper, but looking at one really shows off how nice that Micro OLED display looks. A lake looked like it was rolling up to a rocky shore that ended right where the real coffee table was in front of me. 

man using keyboard to work using apple vision pro headset man using keyboard to work using apple vision pro headset

Raising my hands to my face, I saw how the headset separates my hands from VR, a trick that’s already in Apple’s ARKit. It’s a little rough around the edges but good enough. Similarly, there’s a wild new trick where anyone else in the room can ghost into view if you look at them, a fuzzy halo with their real passthrough video image slowly materializing. It’s meant to help create meaningful contact with people while wearing the headset. I wondered how you could turn that off or tune it to be less present, but it’s a very new idea in mixed reality.

Apple’s digital crown, a small dial borrowed from the Apple Watch, handles reality blend. I could turn the dial to slowly extend the 3D panorama until it surrounded me everywhere, or dial it back so it just emerged a little bit like a 3D window. 

Mixed reality in Apple’s headset looks so casually impressive that I almost didn’t appreciate how great it was. Again, I’ve seen mixed reality in VR headsets before (Varjo XR-3, Quest Pro), and I’ve understood its capabilities. Apple’s execution of mixed reality felt much more immersive, rich and effortless on most fronts, with a field of view that felt expansive and rich. I can’t to see more experiences in it.

Cinematic fidelity that wowed me

The cinema demo was what really shocked me, though. I played a 3D clip of Avatar: The Way of Water in-headset, on a screen in various viewing modes including a cinema. Apple’s mixed-reality passthrough can also dim the rest of the world down a bit, in a way similar to how the Magic Leap 2 does with its AR. But the scenes of Way of Water sent little chills through me. It was vivid. This felt like a movie experience. I don’t feel that way in other VR headsets.

Jake Sully flies over Pandora's waters on a winged creature's back in Avatar: The Way of Water Jake Sully flies over Pandora's waters on a winged creature's back in Avatar: The Way of Water

Avatar: The Way of Water looked great in the Vision Pro.

20th Century Studios

Apple also demonstrated its Immersive Video format that’s coming as an extension to Apple TV Plus. It’s a 180-degree video format, similar to what I’ve seen before in concept, but with really strong resolution and video quality. A splash demo reel of Alicia Keys singing, Apple Sports events, documentary footage and more reeled off in front of me, a teaser of what’s to come. One-eighty-degree video never appears quite as crisp to me as big-screen film content, but the sports clips I saw made me wonder how good virtual Jets games could be in the future. Things have come a long way.

Would I pay $3,499 for a head-worn cinema? No, but it’s clearly one of this device’s greatest unique strengths. The resolution and brightness of the display were surprising.

appledisneypic appledisneypic
Watch this: Apple, Disney Partner on Vision Pro Entertainment

03:59

Convincing avatars (I mean, Personas)

Apple’s Personas are 3D-scanned avatars generated by using the Vision Pro to scan your face, making a version of yourself that shows up in FaceTime chats if you want, or also on the outside of the Vision Pro’s curved OLED display to show whether you’re «present» or in an app. I didn’t see how that outer display worked, but I had a FaceTime with someone in their Persona form, and it was good. Again, it looked surprisingly good.

I’ve chatted with Meta’s ultra-realistic Codec Avatars, which aim for realistic representations of people in VR. Those are stunning, and I’ve also seen Meta’s phone-scanned step-down version in an early form last year, where a talking head spoke to me in VR. Apple’s Persona looked better than Meta’s phone-scanned avatar, although a bit fuzzy around the edges, like a dream. The woman whose Persona was scanned appeared in her own window, not in a full-screen form. 

And I wondered how expressive the emotions are with the Vision Pro’s scanning cameras. The Pro has an ability to scan jaw movement similar to the Quest Pro, and the Persona I chatted with was friendly and smiling. How would it look for someone I know, like my mom? Here, it was good enough that I forgot it was a scan.

We demoed a bit of Apple’s Freeform app, where a collaboration window opened up while my Persona friend chatted in another window. 3D objects popped up in the Freeform app, a full home scan. It looked realistic enough.

Dinosaurs in my world

The final demo was an app experience called Encounter Dinosaurs, which reminded me of early VR app demos I had years ago: An experience emphasizing just the immersive «wow» factor of dinosaurs appearing in a 3D window that seemed to open up in the back wall of my demo room. Creatures that looked like carnotauruses slowly walked through the window and into my space. 

All my demos were seated except for this one, where I stood up and walked around a bit. This sounds like it wouldn’t be an impressive demo, but again, the quality of the visuals and how they looked in relation to the room’s passthrough video capture was what made it feel so great. As the dinosaur snapped at my hand, it felt pretty real. And so did a butterfly that danced through the room and tried to land on my extended finger.

I smiled. But even more so, I was impressed when I took off the headset. My own everyday vision wasn’t that much sharper than what Apple’s passthrough cameras provided. The gap between the two was closer than I would have expected, and it’s what makes Apple’s take on mixed reality in VR work so well.

Then there’s the battery pack. There’s a corded battery that’s needed to power the headset, instead of a built-in battery like most others have. That meant I had to make sure to grab the battery pack as I started to move around, which is probably a reason why so many of Apple’s demos were seated.

230605-clean-apple-wwdc-supercut-thumbnail-1 230605-clean-apple-wwdc-supercut-thumbnail-1
Watch this: Everything Apple Announced at WWDC 2023

11:44

What about fitness and everything else?

Apple didn’t emphasize fitness much at all, a surprise to me. VR is already a great platform for fitness, although no one’s finessed headset design for fitness comfort. Maybe having that battery pack right now will limit movement in active games and experiences. Maybe Apple will announce more plans here later. The only taste I got of health and wellness was a one-minute micro meditation, which was similar to the one on the Apple Watch. It was pretty, and again a great showcase of the display quality, but I want more.

2024 is still a while away, and Apple’s headset is priced way out of range for most people. And I have no idea how functional this current headset would feel if I were doing everyday work. But Apple did show off a display, and an interface, that are far better than I was ready for. If Apple can build on that, and the Vision Pro finds ways of expanding its mixed-reality capabilities, then who knows what else is possible?

This was just my fast-take reaction to a quick set of demos on one day in Cupertino. There are a lot more questions to come, but this first set of demos resonated with me. Apple showed what it can do, and we’re not even at the headset’s launch yet.

Technologies

Tariffs Explained: Latest on Trump’s Shifting Import Tax Plan, and What It Means

Continue Reading

Technologies

Apple, I’m (Sky) Blue About Your iPhone 17 Air Color

Commentary: The rumored new hue of the iPhone 17 Air is more sky blah than sky blue.

I can’t help but feel blue about the latest rumor that Apple’s forthcoming iPhone 17 Air will take flight in a subtle, light-hued color called sky blue.

Sky blue isn’t a new color for Apple. It’s the featured shade of the current M4 MacBook Air, a shimmer of cerulean so subtle as to almost be missed. It’s silver left too close to an aquarium; silver that secretly likes to think it’s blue but doesn’t want everyone else to notice.

Do Apple employees get to go outside and see a real blue sky? It’s actually vivid, you can check for yourself. Perhaps the muted sky blue color reflects a Bay Area late winter/early spring frequent layer of clouds like we typically see here in Seattle.

«Who cares?» you might find yourself saying. «Everyone gets a case anyway.» I hear you and everyone else who’s told me that. But design-focused Apple is as obsessive about colors as they are about making their devices thinner. And I wonder if their heads are in the clouds about which hues adorn their pro products.

Making the case for a caseless color iPhone

I’m more invested in this conversation than most — I’m one of those freaks who doesn’t wrap my phone in a case. I find cases bulky and superfluous, and I like to be able to see Apple’s design work. Also, true story, I’ve broken my iPhone screen only twice: First when it was in a «bumper» that Apple sent free in response to the iPhone 4 you’re-holding-it-wrong Antennagate fiasco, and second when trying to take long exposure starry night photos using what I didn’t realize was a broken tripod mount. My one-week-old iPhone 13 Pro slipped sideways and landed screen-first on a pointy rock. A case wouldn’t have saved it.

My current model is an iPhone 16 Pro in black titanium — which I know seems like avoiding color entirely — but previously I’ve gone for colors like blue titanium and deep purple. I wanted to like deep purple the most but it came across as, in the words of Patrick Holland in his iPhone 14 Pro review, «a drab shade of gray or like Grimace purple,» depending on the light.

Pros can be bold, too

Maybe the issue is too many soft blues. Since the iPhone Pro age began with the iPhone 11 Pro, we’ve seen variations like blue titanium (iPhone 15 Pro), sierra blue (iPhone 13 Pro) and pacific blue (iPhone 12 Pro).

Pacific blue is the boldest of the bunch, if by bold you mean dark enough to discern from silver, but it’s also close enough to that year’s graphite color that seeing blue depends on the surrounding lighting. By comparison, the blue (just «blue») color of the iPhone 12 was unmistakably bright blue.

In fact, the non-Pro lines have embraced vibrant colors. It’s as if Apple is equating «pro» with «sophisticated,» as in «A real pro would never brandish something this garish.» I see this in the camera world all the time: If it’s not all-black, it’s not a «serious» camera.

And yet I know lots of pros who are not sophisticated — proudly so. People choose colors to express themselves, so forcing that idea of professionalism through color feels needlessly restrictive. A bright pink iPhone 16 might make you smile every time you pick it up but then frown because it doesn’t have a telephoto camera.

Color is also important because it can sway a purchase decision. «I would buy a sky blue iPhone yesterday,» my colleague Gael Cooper texted after the first rumor popped online. When each new generation of iPhones arrive, less technically different than the one before, a color you fall in love with can push you into trading in your perfectly-capable model for a new one.

And lest you think Apple should just stick with black and white for its professional phones: Do you mean black, jet black, space black, midnight black, black titanium, graphite or space gray? At least the lighter end of the spectrum has stuck to just white, white titanium and silver over the years.

Apple never got ahead by being beige

I’m sure Apple has reams of studies and customer feedback that support which colors make it to production each year. Like I said, Apple’s designers are obsessive (in a good way). And I must remind myself that a sky blue iPhone 17 Air is a rumored color on a rumored product so all the usual caveats apply.

But we’re talking about Apple here. The scrappy startup that spent more than any other company on business cards at the time because each one included the old six-color Apple logo. The company that not only shaped the first iMac like a tipped-over gumdrop, that not only made the case partially see-through but then made that cover brilliant Bondi blue.

Embrace the iPhone colors, Apple.

If that makes you nervous, don’t worry: Most people will put a case on it anyway.

Continue Reading

Technologies

Astronomers Say There’s an Increased Possibility of Life on This Distant Planet

Using the James Webb Space Telescope, astronomers are working to confirm potential evidence of life on a distant exoplanet dubbed K2-18b.

Astronomers are nearing a statistically significant finding that could confirm the potential signs of life detected on the distant exoplanet K2-18b are no accident.

The team of astronomers, led by the University of Cambridge, used data from the James Webb Space Telescope (which has only been in use since the end of 2021) to detect chemical traces of dimethyl sulfide (DMS) and/or dimethyl disulfide (DMDS), which they say can only be produced by life such as phytoplankton in the sea. 

According to the university, «the results are the strongest evidence yet that life may exist on a planet outside our solar system.»

The findings were published this week in the Astrophysical Journal Letters and point to the possibility of an ocean on this planet’s surface, which scientists have been hoping to discover for years. In the abstract for the paper, the team says, «The possibility of hycean worlds, with planet-wide oceans and H2-rich atmospheres, significantly expands and accelerates the search for habitable environments elsewhere.»

Not everyone agrees, however, that what the team found proves there’s life on the exoplanet.

Science writer and OpenMind Magazine founder Corey S. Powell posted about the findings on Bluesky, writing, «The potential discovery of alien life is so enticing that it drags even reputable outlets into running naive or outright misleading stories.» He added, «Here we go again with planet K2-18b.Um….there’s strong evidence of non-biological sources of the molecule DMS.»

K2-18b is 124 light-years away and much larger than Earth (more than eight times our mass), but smaller than Neptune. The search for signs of even basic life on a planet like this increases the chances that there are more planets like Earth that may be inhabitable, with temperatures and atmospheres that could sustain human-like lifeforms. The team behind the paper hopes that more study with the James Webb Space Telescope will help confirm their initial findings.

More research to do on finding life on K2-18b

The exoplanet K2-18b is not the only place where scientists are exploring the possibility of life, and this research is still an early step in the process, said Christopher Glein, a geochemist, planetary researcher and lead scientist at San Antonio’s Southwest Research Institute. Excitement over the significance of the research, he said, should be tempered.

«We need to be careful here,» Glein said. «It appears that there is something in the data that can’t be explained, and DMS/DMDS can provide an explanation. But this detection is stretching the limits of JWST’s capabilities.»

Glein added, «Further work is needed to test whether these molecules are actually present. We also need complementary research assessing the abiotic background on K2-18b and similar planets. That is, the chemistry that can occur in the absence of life in this potentially exotic environment. We might be seeing evidence of some cool chemistry rather than life.»

The TRAPPIST-1 planets, he said, are being researched as potentially habitable, as is LHS 1140b, which he said «is another astrobiologically significant exoplanet, which might be a massive ocean world.»

As for K2-18b, Glein said many more tests need to be performed before there’s consensus on life existing on it.

«Finding evidence of life is like prosecuting a case in the courtroom,» Glein said. «Multiple independent lines of evidence are needed to convince the jury, in this case the worldwide scientific community.» He added, «If this finding holds up, then that’s Step 1.»

Continue Reading

Trending

Copyright © Verum World Media