Technologies

Apple Vision Pro Hands-On: Far Better Than I Was Ready For

I experienced incredible fidelity, surprising video quality and a really smooth interface. Apple’s first mixed-reality headset nails those, but lots of questions remain.

I was in a movie theater last December watching Avatar: The Way of Water in 3D, and I said to myself: «Wow, this is an immersive film I’d love to watch in next-gen VR.» That’s exactly what I experienced in Apple’s Vision Pro headset, and yeah, it’s amazing.

On Monday, I tried out the Vision Pro in a series of carefully picked demos during WWDC at Apple’s Cupertino, California, headquarters. I’ve been using cutting-edge VR devices for years, and I found all sorts of augmented reality memories bubbling up in my brain. Apple’s compact — but still not small —headset reminds me of an Apple-designed Meta Quest Pro. The fit of the back strap was comfy yet stretchy, with a dial to adjust the rear fit and a top strap for stability. The headset’s sleek design, and even its glowing front faceplate, also gave me an instant Ready Player One vibe.

vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png

Watch this: Apple Vision Pro: I Tried Apple’s AR/VR Headset

05:35

I couldn’t wear my glasses during the demo, though, and neither will you. Apple’s headset does not support glasses, instead relying on Zeiss custom inserts to correct wearers’ vision. Apple did manage, through a setup process, to easily find lenses that fit my vision well enough so that everything seemed crystal clear, which is not an easy task. Also, we adjusted the fit and tuned spatial audio for my head using an iPhone, a system that will be finessed when the headset is released in 2024.

From there, I did my demos seated, mostly, and found myself surprised from the start. The passthrough video camera quality of this headset is good —really, really good. Not as good as my own vision, but good enough that I could see the room well, see people in it with me, see my watch notifications easily on my wrist. The only headset that’s done this previously was the extremely impressive but PC-connected Varjo XR-3, and Apple’s display and cameras feel even better.

Apple’s floating grid of apps appears when I press the top digital crown, which autocenters the home screen to wherever I’m looking. I set up eye tracking, which worked like on many other VR headsets I’ve used: I looked at glowing dots as musical notes played, and got a chime when it all worked.

An app menu in Apple's VisionOS. — A list of apps as they would appear inside of the Apple Vision Pro headset.

Apple/Screenshot by CNET

From there, the interface was surprisingly fluid. Looking at icons or interface options slightly enlarges them, or changes how bold they appear. Tapping with my fingers while looking at something opens an app.

I’ve used tons of hand-tracking technology on headsets like the HoloLens 2 and the Meta Quest 2 and Pro, and usually there’s a lot of hand motion required. Here, I could be really lazy. I pinched to open icons even while my hand was resting in my lap, and it worked.

Scrolling involves pinching and pulling with my fingers; again, pretty easy to do. I resized windows by moving my hand to throw a window across the room or pin it closer to me. I opened multiple apps at once, including Safari, Messages and Photos. It was easy enough to scroll around, although sometimes my eye tracking needed a bit of extra concentration to pull off.

More from WWDC 2023

Apple’s headset uses eye tracking constantly in its interface, something Meta’s Quest Pro and even the PlayStation VR 2 don’t do. That might be part of the reason for the external battery pack. The emphasis on eye tracking as a major part of the interface felt transformative, in a way I expected might be the case for VR and AR years ago. What I don’t know is how it will feel in longer sessions.

I don’t know how the Vision Pro will work with keyboards and trackpads, since I didn’t get to demo the headset that way. It works with Apple’s Magic Keyboard and Magic Trackpad, and Macs, but not with iPhone and iPad or Watch touchscreens —not now, at least.

Dialing in reality

I scrolled through some photos in Apple’s preset photo album, plus a few 3D photos and video clips shot with the Vision Pro’s 3D camera. All the images looked really crisp, and a panoramic photo that spread around me looked almost like it was a window on a landscape that extended just beyond the room I was in.

Apple has volumetric 3D landscapes on the Vision Pro that are immersive backgrounds like 3D wallpaper, but looking at one really shows off how nice that Micro OLED display looks. A lake looked like it was rolling up to a rocky shore that ended right where the real coffee table was in front of me.

man using keyboard to work using apple vision pro headset

Raising my hands to my face, I saw how the headset separates my hands from VR, a trick that’s already in Apple’s ARKit. It’s a little rough around the edges but good enough. Similarly, there’s a wild new trick where anyone else in the room can ghost into view if you look at them, a fuzzy halo with their real passthrough video image slowly materializing. It’s meant to help create meaningful contact with people while wearing the headset. I wondered how you could turn that off or tune it to be less present, but it’s a very new idea in mixed reality.

Apple’s digital crown, a small dial borrowed from the Apple Watch, handles reality blend. I could turn the dial to slowly extend the 3D panorama until it surrounded me everywhere, or dial it back so it just emerged a little bit like a 3D window.

Mixed reality in Apple’s headset looks so casually impressive that I almost didn’t appreciate how great it was. Again, I’ve seen mixed reality in VR headsets before (Varjo XR-3, Quest Pro), and I’ve understood its capabilities. Apple’s execution of mixed reality felt much more immersive, rich and effortless on most fronts, with a field of view that felt expansive and rich. I can’t to see more experiences in it.

Cinematic fidelity that wowed me

The cinema demo was what really shocked me, though. I played a 3D clip of Avatar: The Way of Water in-headset, on a screen in various viewing modes including a cinema. Apple’s mixed-reality passthrough can also dim the rest of the world down a bit, in a way similar to how the Magic Leap 2 does with its AR. But the scenes of Way of Water sent little chills through me. It was vivid. This felt like a movie experience. I don’t feel that way in other VR headsets.

Avatar: The Way of Water looked great in the Vision Pro.

20th Century Studios

Apple also demonstrated its Immersive Video format that’s coming as an extension to Apple TV Plus. It’s a 180-degree video format, similar to what I’ve seen before in concept, but with really strong resolution and video quality. A splash demo reel of Alicia Keys singing, Apple Sports events, documentary footage and more reeled off in front of me, a teaser of what’s to come. One-eighty-degree video never appears quite as crisp to me as big-screen film content, but the sports clips I saw made me wonder how good virtual Jets games could be in the future. Things have come a long way.

Would I pay $3,499 for a head-worn cinema? No, but it’s clearly one of this device’s greatest unique strengths. The resolution and brightness of the display were surprising.

Watch this: Apple, Disney Partner on Vision Pro Entertainment

03:59

Convincing avatars (I mean, Personas)

Apple’s Personas are 3D-scanned avatars generated by using the Vision Pro to scan your face, making a version of yourself that shows up in FaceTime chats if you want, or also on the outside of the Vision Pro’s curved OLED display to show whether you’re «present» or in an app. I didn’t see how that outer display worked, but I had a FaceTime with someone in their Persona form, and it was good. Again, it looked surprisingly good.

I’ve chatted with Meta’s ultra-realistic Codec Avatars, which aim for realistic representations of people in VR. Those are stunning, and I’ve also seen Meta’s phone-scanned step-down version in an early form last year, where a talking head spoke to me in VR. Apple’s Persona looked better than Meta’s phone-scanned avatar, although a bit fuzzy around the edges, like a dream. The woman whose Persona was scanned appeared in her own window, not in a full-screen form.

And I wondered how expressive the emotions are with the Vision Pro’s scanning cameras. The Pro has an ability to scan jaw movement similar to the Quest Pro, and the Persona I chatted with was friendly and smiling. How would it look for someone I know, like my mom? Here, it was good enough that I forgot it was a scan.

We demoed a bit of Apple’s Freeform app, where a collaboration window opened up while my Persona friend chatted in another window. 3D objects popped up in the Freeform app, a full home scan. It looked realistic enough.

Dinosaurs in my world

The final demo was an app experience called Encounter Dinosaurs, which reminded me of early VR app demos I had years ago: An experience emphasizing just the immersive «wow» factor of dinosaurs appearing in a 3D window that seemed to open up in the back wall of my demo room. Creatures that looked like carnotauruses slowly walked through the window and into my space.

All my demos were seated except for this one, where I stood up and walked around a bit. This sounds like it wouldn’t be an impressive demo, but again, the quality of the visuals and how they looked in relation to the room’s passthrough video capture was what made it feel so great. As the dinosaur snapped at my hand, it felt pretty real. And so did a butterfly that danced through the room and tried to land on my extended finger.

I smiled. But even more so, I was impressed when I took off the headset. My own everyday vision wasn’t that much sharper than what Apple’s passthrough cameras provided. The gap between the two was closer than I would have expected, and it’s what makes Apple’s take on mixed reality in VR work so well.

Then there’s the battery pack. There’s a corded battery that’s needed to power the headset, instead of a built-in battery like most others have. That meant I had to make sure to grab the battery pack as I started to move around, which is probably a reason why so many of Apple’s demos were seated.

230605-clean-apple-wwdc-supercut-thumbnail-1

Watch this: Everything Apple Announced at WWDC 2023

11:44

What about fitness and everything else?

Apple didn’t emphasize fitness much at all, a surprise to me. VR is already a great platform for fitness, although no one’s finessed headset design for fitness comfort. Maybe having that battery pack right now will limit movement in active games and experiences. Maybe Apple will announce more plans here later. The only taste I got of health and wellness was a one-minute micro meditation, which was similar to the one on the Apple Watch. It was pretty, and again a great showcase of the display quality, but I want more.

2024 is still a while away, and Apple’s headset is priced way out of range for most people. And I have no idea how functional this current headset would feel if I were doing everyday work. But Apple did show off a display, and an interface, that are far better than I was ready for. If Apple can build on that, and the Vision Pro finds ways of expanding its mixed-reality capabilities, then who knows what else is possible?

This was just my fast-take reaction to a quick set of demos on one day in Cupertino. There are a lot more questions to come, but this first set of demos resonated with me. Apple showed what it can do, and we’re not even at the headset’s launch yet.

Technologies

Today’s NYT Connections: Sports Edition Hints and Answers for Sept. 10, #352

Here are hints and the answers for the NYT Connections: Sports Edition puzzle for Sept. 10, No. 352

Looking for the most recent regular Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle and Strands puzzles.

Today’s Connections: Sports Edition is a tough one. But if you’re a shoe junkie, you might ace the blue category. If you’re struggling but still want to solve it, read on for hints and the answers.

Connections: Sports Edition is published by The Athletic, the subscription-based sports journalism site owned by the Times. It doesn’t show up in the NYT Games app but appears in The Athletic’s own app. Or you can play it for free online.

Read more: NYT Connections: Sports Edition Puzzle Comes Out of Beta

Hints for today’s Connections: Sports Edition groups

Here are four hints for the groupings in today’s Connections: Sports Edition puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Baseball grouping.

Green group hint: You might do this to a door.

Blue group hint: Just do it.

Purple group hint: Not real coaches, but…

Answers for today’s Connections: Sports Edition groups

Yellow group: NL East teams.

Green group: Synonyms of slam, in basketball.

Blue group: Nike shoes.

Purple group: Actors who played football coaches.

Read more: Wordle Cheat Sheet: Here Are the Most Popular Letters Used in English Words

What are today’s Connections: Sports Edition answers?

The yellow words in today’s Connections

The theme is NL East teams. The four answers are Atlanta, Miami, New York and Philadelphia.

The green words in today’s Connections

The theme is synonyms of slam, in basketball. The four answers are drunk, flush, jam and stuff.

The blue words in today’s Connections

The theme is Nike shoes. The four answers are Blazer, Cortez, Pegasus and Shox.

The purple words in today’s Connections

The theme is actors who played football coaches. The four answers are Pacino, Thornton, Washington and Winkler.

Technologies

Today’s NYT Strands Hints, Answers and Help for Sept. 10

Here are hints and answers for the NYT Strands puzzle for Sept. 10, No. 556

Looking for the most recent Strands answer? Click here for our daily Strands hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle, Connections and Connections: Sports Edition puzzles.

Today’s NYT Strands puzzle has a fun, timely theme. Once you figure out the topic, the answers come easily. If you need hints and answers, read on.

I go into depth about the rules for Strands in this story.

If you’re looking for today’s Wordle, Connections and Mini Crossword answers, you can visit CNET’s NYT puzzle hints page.

Read more: NYT Connections Turns 1: These Are the 5 Toughest Puzzles So Far

Hint for today’s Strands puzzle

Today’s Strands theme is: Keep it classy.

If that doesn’t help you, here’s a clue: School days.

Clue words to unlock in-game hints

Your goal is to find hidden words that fit the puzzle’s theme. If you’re stuck, find any words you can. Every time you find three words of four letters or more, Strands will reveal one of the theme words. These are the words I used to get those hints but any words of four or more letters that you find will work:

HOLE, DOLE, SCENE, SCENES, CURE, CURES, SLIM, SLIME, SLIMED, NICE

Answers for today’s Strands puzzle

These are the answers that tie into the theme. The goal of the puzzle is to find them all, including the spangram, a theme word that reaches from one side of the puzzle to the other. When you have all of them (I originally thought there were always eight but learned that the number can vary), every letter on the board will be used. Here are the nonspangram answers:

MATH, LUNCH, MUSIC, ENGLISH, SCIENCE, RECESS

Today’s Strands spangram

Today’s Strands spangram is SCHOOLSCHEDULE. To find it, look for the S that’s the first letter on the far left on the top row, and wind down.

Technologies

Apple Watch Ultra 3 Rewards Smartwatch Owners’ Patience

The high-performance Apple smartwatch gets the upgrade people have been waiting for.

If you’re more comfortable hiking mountain trails or gliding under water, or you just prefer a chunky smartwatch with days of battery life, your patience over the last couple of years has paid off.

Today, Apple announced the Apple Watch Ultra 3, the next generation of its high-performance smartwatch. The Ultra 3 adds a brighter, larger display, 5G cellular communication, satellite connectivity, a battery life increase of up to 42 hours and the ability to detect whether you might be suffering from hypertension.

Apple Watch Ultra fans have had to spend a while watching time pass on their Ultra-exclusive Wayfinder face. The Ultra 2 arrived in 2023, but last year Apple merely added a new Satin Black color — even as the Apple Watch Series 10 gained a better processor and adopted a screen that became the largest in the line.

Now the Ultra 3 is here to satisfy those who want the most smartwatch Apple can offer.

The Apple Watch Ultra 3 costs $799 (£749, AU$1,399), with preorders starting today. The first shipments and in-store availability arrive Sept. 19.

We’re following Apple news closely to see how it compares to everything we had expected to see.

The Apple Watch Ultra 3 screen size is back on top

The brilliant screen on the Apple Watch Ultra 3 is now slightly larger than its predecessor, at a 422×514-pixel resolution (up from the Ultra 2’s 410×502 pixels), though the case itself hasn’t expanded. Instead, Apple has slimmed the bezel to bring the active edge of the screen closer to the frame.

Speaking of the frame, it’s now created using a 3D printing process that uses 100% recycled titanium and half the amount of raw materials as earlier generations.

The screen is also better than the Ultra 2, with an LPTO3 OLED always-on Retina display that has the same faster refresh rate introduced with the Series 10. That means you’ll see a second hand that continually updates, or an active stopwatch timer, without having to raise your wrist and engage the screen. Screen brightness when viewing from an angle has also improved, according to Apple.

Even more battery life

The Apple Watch Ultra and Ultra 2 boasted much longer battery stamina than the regular watch, thanks to their physically larger batteries: about 36 hours of regular use, or 72 hours with low power mode on.

With the Apple Watch Ultra 3, you might forget the last time you put it onto its charger. Its larger battery and improved battery life get up to 42 hours on a charge. Continuous workouts can extend to 20 hours in low power mode while retaining full GPS and heart rate readings.

The Ultra 3 also joins the Series 10 and Series 11 by offering fast charging. Apple claims 45 minutes of charging will get the watch up to 80% full, or 75 minutes to top out at 100%. Since most people probably aren’t going to run the watch down to zero, a more realistic circumstance is being able to pop it onto a charger for just 15 minutes and gain 12 hours of battery life.

Apple says a number of factors contribute to the improved battery life in the Ultra 3: the more efficient display, larger battery and redesigned radios for 5G cellular and satellite communications. We expected a new processor as well, but surprisingly, the Ultra 3 is powered by the same S10 chip that runs the Apple Watch Series 11 and Series 10.

Connect to satellite services, even without an iPhone

Most phones and smartwatches are designed with the expectation that they operate in areas where cellular or Wi-Fi networks are easily available. The Apple Watch Ultra almost expects you to get lost, with that larger battery and dual-GPS location tracking. But if something unfortunate happens while you’re away from everything, you still want to be able to signal for help or keep friends alerted to your whereabouts.

The Ultra 3 now includes on-device satellite communication, which means as long as the watch has a view of the sky, it can connect to satellites. In most situations, you’d also have a satellite-capable iPhone with you, but that’s not helpful if the phone’s battery is drained. Apple says it redesigned the radios and antenna to double the signal strength.

As with the iPhone, Emergency SOS via satellite is free for two years, though Apple has not announced any pricing for the service since it was launched. Text messaging and Find My services via satellite are also available as long as you have an active cellular plan.

As for cellular connections, all configurations of the Apple Watch Ultra include cellular capabilities, and now the Ultra 3 is capable of connecting to 5G networks. It uses 5G RedCap (for «reduced capacity») technology, which delivers 5G access but without the power requirements that a device such as the iPhone can handle easily.

Health and fitness features at the forefront

As with the Apple Watch Series 11, the Ultra 3 also looks for possible hypertension, or high blood pressure, based on readings it takes during the course of a month. Apple expects its hypertension detection, currently under review by the FDA, to be available in 150 countries and regions this month.

That’s in addition to existing heart rate and ECG measuring, as well as the ability to detect blood-oxygen levels, a feature that’s been temporarily blocked in the US due to litigation (though Apple recently developed a workaround).

Apple also announced that the Sleep app will include a new Sleep Score feature to help users track and adjust sleep more easily.

When Apple announced WatchOS 26 and iOS 26, it introduced Workout Buddy, a virtual companion that provides stats and encouragement while you’re working out, such as on a bike ride, run or walk. (CNET’s Vanessa Hand Orellana got details from Apple’s team developing it.) As a watch designed for workouts, it’s natural that the Apple Watch Ultra 3 brings Workout Buddy along for the ride/run/amble.

Other health and workout features carry over from the Ultra 2, such as water resistance to 100m and scuba diving to 40m, IP6X dust resistance and durability in extreme temperature and altitude environments. It includes dual GPS (L1 and L5) radios for more precise location tracking and wayfinding.