Technologies

Apple Vision Pro Hands-On: Far Better Than I Was Ready For

I experienced incredible fidelity, surprising video quality and a really smooth interface. Apple’s first mixed-reality headset nails those, but lots of questions remain.

I was in a movie theater last December watching Avatar: The Way of Water in 3D, and I said to myself: «Wow, this is an immersive film I’d love to watch in next-gen VR.» That’s exactly what I experienced in Apple’s Vision Pro headset, and yeah, it’s amazing.

On Monday, I tried out the Vision Pro in a series of carefully picked demos during WWDC at Apple’s Cupertino, California, headquarters. I’ve been using cutting-edge VR devices for years, and I found all sorts of augmented reality memories bubbling up in my brain. Apple’s compact — but still not small —headset reminds me of an Apple-designed Meta Quest Pro. The fit of the back strap was comfy yet stretchy, with a dial to adjust the rear fit and a top strap for stability. The headset’s sleek design, and even its glowing front faceplate, also gave me an instant Ready Player One vibe.

vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png

Watch this: Apple Vision Pro: I Tried Apple’s AR/VR Headset

05:35

I couldn’t wear my glasses during the demo, though, and neither will you. Apple’s headset does not support glasses, instead relying on Zeiss custom inserts to correct wearers’ vision. Apple did manage, through a setup process, to easily find lenses that fit my vision well enough so that everything seemed crystal clear, which is not an easy task. Also, we adjusted the fit and tuned spatial audio for my head using an iPhone, a system that will be finessed when the headset is released in 2024.

From there, I did my demos seated, mostly, and found myself surprised from the start. The passthrough video camera quality of this headset is good —really, really good. Not as good as my own vision, but good enough that I could see the room well, see people in it with me, see my watch notifications easily on my wrist. The only headset that’s done this previously was the extremely impressive but PC-connected Varjo XR-3, and Apple’s display and cameras feel even better.

Apple’s floating grid of apps appears when I press the top digital crown, which autocenters the home screen to wherever I’m looking. I set up eye tracking, which worked like on many other VR headsets I’ve used: I looked at glowing dots as musical notes played, and got a chime when it all worked.

An app menu in Apple's VisionOS. — A list of apps as they would appear inside of the Apple Vision Pro headset.

Apple/Screenshot by CNET

From there, the interface was surprisingly fluid. Looking at icons or interface options slightly enlarges them, or changes how bold they appear. Tapping with my fingers while looking at something opens an app.

I’ve used tons of hand-tracking technology on headsets like the HoloLens 2 and the Meta Quest 2 and Pro, and usually there’s a lot of hand motion required. Here, I could be really lazy. I pinched to open icons even while my hand was resting in my lap, and it worked.

Scrolling involves pinching and pulling with my fingers; again, pretty easy to do. I resized windows by moving my hand to throw a window across the room or pin it closer to me. I opened multiple apps at once, including Safari, Messages and Photos. It was easy enough to scroll around, although sometimes my eye tracking needed a bit of extra concentration to pull off.

More from WWDC 2023

Apple’s headset uses eye tracking constantly in its interface, something Meta’s Quest Pro and even the PlayStation VR 2 don’t do. That might be part of the reason for the external battery pack. The emphasis on eye tracking as a major part of the interface felt transformative, in a way I expected might be the case for VR and AR years ago. What I don’t know is how it will feel in longer sessions.

I don’t know how the Vision Pro will work with keyboards and trackpads, since I didn’t get to demo the headset that way. It works with Apple’s Magic Keyboard and Magic Trackpad, and Macs, but not with iPhone and iPad or Watch touchscreens —not now, at least.

Dialing in reality

I scrolled through some photos in Apple’s preset photo album, plus a few 3D photos and video clips shot with the Vision Pro’s 3D camera. All the images looked really crisp, and a panoramic photo that spread around me looked almost like it was a window on a landscape that extended just beyond the room I was in.

Apple has volumetric 3D landscapes on the Vision Pro that are immersive backgrounds like 3D wallpaper, but looking at one really shows off how nice that Micro OLED display looks. A lake looked like it was rolling up to a rocky shore that ended right where the real coffee table was in front of me.

man using keyboard to work using apple vision pro headset

Raising my hands to my face, I saw how the headset separates my hands from VR, a trick that’s already in Apple’s ARKit. It’s a little rough around the edges but good enough. Similarly, there’s a wild new trick where anyone else in the room can ghost into view if you look at them, a fuzzy halo with their real passthrough video image slowly materializing. It’s meant to help create meaningful contact with people while wearing the headset. I wondered how you could turn that off or tune it to be less present, but it’s a very new idea in mixed reality.

Apple’s digital crown, a small dial borrowed from the Apple Watch, handles reality blend. I could turn the dial to slowly extend the 3D panorama until it surrounded me everywhere, or dial it back so it just emerged a little bit like a 3D window.

Mixed reality in Apple’s headset looks so casually impressive that I almost didn’t appreciate how great it was. Again, I’ve seen mixed reality in VR headsets before (Varjo XR-3, Quest Pro), and I’ve understood its capabilities. Apple’s execution of mixed reality felt much more immersive, rich and effortless on most fronts, with a field of view that felt expansive and rich. I can’t to see more experiences in it.

Cinematic fidelity that wowed me

The cinema demo was what really shocked me, though. I played a 3D clip of Avatar: The Way of Water in-headset, on a screen in various viewing modes including a cinema. Apple’s mixed-reality passthrough can also dim the rest of the world down a bit, in a way similar to how the Magic Leap 2 does with its AR. But the scenes of Way of Water sent little chills through me. It was vivid. This felt like a movie experience. I don’t feel that way in other VR headsets.

Avatar: The Way of Water looked great in the Vision Pro.

20th Century Studios

Apple also demonstrated its Immersive Video format that’s coming as an extension to Apple TV Plus. It’s a 180-degree video format, similar to what I’ve seen before in concept, but with really strong resolution and video quality. A splash demo reel of Alicia Keys singing, Apple Sports events, documentary footage and more reeled off in front of me, a teaser of what’s to come. One-eighty-degree video never appears quite as crisp to me as big-screen film content, but the sports clips I saw made me wonder how good virtual Jets games could be in the future. Things have come a long way.

Would I pay $3,499 for a head-worn cinema? No, but it’s clearly one of this device’s greatest unique strengths. The resolution and brightness of the display were surprising.

Watch this: Apple, Disney Partner on Vision Pro Entertainment

03:59

Convincing avatars (I mean, Personas)

Apple’s Personas are 3D-scanned avatars generated by using the Vision Pro to scan your face, making a version of yourself that shows up in FaceTime chats if you want, or also on the outside of the Vision Pro’s curved OLED display to show whether you’re «present» or in an app. I didn’t see how that outer display worked, but I had a FaceTime with someone in their Persona form, and it was good. Again, it looked surprisingly good.

I’ve chatted with Meta’s ultra-realistic Codec Avatars, which aim for realistic representations of people in VR. Those are stunning, and I’ve also seen Meta’s phone-scanned step-down version in an early form last year, where a talking head spoke to me in VR. Apple’s Persona looked better than Meta’s phone-scanned avatar, although a bit fuzzy around the edges, like a dream. The woman whose Persona was scanned appeared in her own window, not in a full-screen form.

And I wondered how expressive the emotions are with the Vision Pro’s scanning cameras. The Pro has an ability to scan jaw movement similar to the Quest Pro, and the Persona I chatted with was friendly and smiling. How would it look for someone I know, like my mom? Here, it was good enough that I forgot it was a scan.

We demoed a bit of Apple’s Freeform app, where a collaboration window opened up while my Persona friend chatted in another window. 3D objects popped up in the Freeform app, a full home scan. It looked realistic enough.

Dinosaurs in my world

The final demo was an app experience called Encounter Dinosaurs, which reminded me of early VR app demos I had years ago: An experience emphasizing just the immersive «wow» factor of dinosaurs appearing in a 3D window that seemed to open up in the back wall of my demo room. Creatures that looked like carnotauruses slowly walked through the window and into my space.

All my demos were seated except for this one, where I stood up and walked around a bit. This sounds like it wouldn’t be an impressive demo, but again, the quality of the visuals and how they looked in relation to the room’s passthrough video capture was what made it feel so great. As the dinosaur snapped at my hand, it felt pretty real. And so did a butterfly that danced through the room and tried to land on my extended finger.

I smiled. But even more so, I was impressed when I took off the headset. My own everyday vision wasn’t that much sharper than what Apple’s passthrough cameras provided. The gap between the two was closer than I would have expected, and it’s what makes Apple’s take on mixed reality in VR work so well.

Then there’s the battery pack. There’s a corded battery that’s needed to power the headset, instead of a built-in battery like most others have. That meant I had to make sure to grab the battery pack as I started to move around, which is probably a reason why so many of Apple’s demos were seated.

230605-clean-apple-wwdc-supercut-thumbnail-1

Watch this: Everything Apple Announced at WWDC 2023

11:44

What about fitness and everything else?

Apple didn’t emphasize fitness much at all, a surprise to me. VR is already a great platform for fitness, although no one’s finessed headset design for fitness comfort. Maybe having that battery pack right now will limit movement in active games and experiences. Maybe Apple will announce more plans here later. The only taste I got of health and wellness was a one-minute micro meditation, which was similar to the one on the Apple Watch. It was pretty, and again a great showcase of the display quality, but I want more.

2024 is still a while away, and Apple’s headset is priced way out of range for most people. And I have no idea how functional this current headset would feel if I were doing everyday work. But Apple did show off a display, and an interface, that are far better than I was ready for. If Apple can build on that, and the Vision Pro finds ways of expanding its mixed-reality capabilities, then who knows what else is possible?

This was just my fast-take reaction to a quick set of demos on one day in Cupertino. There are a lot more questions to come, but this first set of demos resonated with me. Apple showed what it can do, and we’re not even at the headset’s launch yet.

Technologies

Lemon8 and TikTok Could Be Banned. Here’s How the Apps Are Different

TikTok and Lemon8 are owned by the same parent company, but they offer different experiences.

TikTok faces another sale deadline Saturday, and unless a US buyer intervenes — or President Donald Trump extends the deadline again — the app could disappear for US users. If the ban goes into effect, TikTok wouldn’t be the only app to disappear: TikTok’s sister app, Lemon8, could be caught in the crossfire.

Read more: A VPN Alone Probably Won’t Bypass TikTok Bans. Here’s Why

Lemon8 is owned by ByteDance, the same parent company that owns TikTok. It’s one of the top Lifestyle apps in Apple’s App Store, and it has more than 10 million downloads in the Google Play store.

«Lemon8 is a lifestyle community focused app powered by TikTok, where you can discover and share authentic content on a variety of topics such as beauty, fashion, travel, food, and more,» the app’s description reads in both stores.

Here’s what you need to know about Lemon8.

Note: I reached out to ByteDance for this story, and the company did not respond for comment.

What is Lemon8?

Lemon8 is a video- and photo-sharing platform that eschews the vertical-scrolling format of TikTok in favor of a Pinterest board-style format. But what Lemon8 and TikTok do have in common is that both have Following and For You tabs to show you posts from creators you follow and posts the app thinks you will like.

Lemon8’s content is split into six topic tabs, plus a seventh tab called All. The other tabs are Fashion, Beauty, Food, Wellness, Travel and Home. These tabs can be found across the top of your screen, and tapping into these tabs shows you recommended and suggested posts.

Posts can be swipeable photo collections like in Instagram, or TikTok-style videos. Some creators add text to their photos to label clothing or a product. Some will also include the price of the item in the text.

How is Lemon8 different from TikTok and other apps?

Lemon8 is different from other apps in terms of what is posted and how it’s presented.

Lemon8 has a lot of influencer ads and product recommendations. It’s difficult to tell what is and isn’t sponsored content, and this appears to be the norm across the app. TikTok also has sponsored content, but usually these are marked as such in the bottom-left corner.

There aren’t a lot of memes or jokes on Lemon8 compared to other apps, either. You can find memes on Lemon8, but various hashtags associated with «memes,» like «funnymemes» and «catmemes,» have fewer than 1 million views (as opposed to hundreds of millions on Instagram). This could be because Lemon8 is still catching on in the US, but my suspicion is Lemon8 isn’t meant for memes. It’s meant to be more of a guidebook to help you achieve a certain lifestyle or aesthetic.

There’s also a lot of writing in Lemon8. For example, post captions might include instructions for a recipe or a deeper breakdown of an outfit. TikTok captions can have useful information, but those captions are more about connecting posts to hashtags to get more views and don’t necessarily add new information to the TikTok post. Lemon8 uses captions in a similar way to Instagram posts, but Lemon8 captions have one key difference from Instagram: templates.

Lemon8 lets you use templates for your posts to help you quickly format and to give you an idea of what to caption your post. There are caption templates for fashion, shopping finds, beauty, food and travel.

Lemon8 reminds me of a mashup between the magazines Martha Stewart Living, Muscle & Fitness and Travel + Leisure. You can find some useful tips in Lemon8 to help you achieve a desired aesthetic or find some vacation inspiration, but it’s not clear what is and isn’t an ad.

What are people saying about Lemon8?

People’s reaction to Lemon8 is seemingly positive so far. One TikTok creator posted a video calling Lemon8 «Pinterest, but interactive.» Another said Lemon8 is a combination of Pinterest, Instagram and TikTok.

However, this positivity could be artificially inflated. ZDNet reports that many TikTok posts about Lemon8 have described the app with similar language, making some believe ByteDance paid these creators.

And some Lemon8 creators’ claims make this theory sound more viable. One Lemon8 creator told Insider that ByteDance paid them to post on the app. Two other Lemon8 creators showed Insider emails that outlined the app’s payment structure.

Who owns Lemon8?

ByteDance, the Chinese tech company that owns TikTok, also owns Lemon8. According to ZDNet, ByteDance is positioning Lemon8 to be an Instagram rival as more users stop using, or abandon, Meta’s app.

According to the Wall Street Journal, a leaked internal memo from Meta showed that Instagram engagement was declining. ByteDance executives could be hoping to capitalize on this by giving Instagram users an alternative app in the form of Lemon8. And while Lemon8 was released globally in 2020, the app’s recent growth might show ByteDance’s gamble is paying off.

Will Lemon8 be banned alongside TikTok?

Since Lemon8 is owned by ByteDance, which also owns TikTok, it’s possible that the app will be banned alongside TikTok on April 5.

The law requiring the sale of TikTok could be applied generally to other apps that are owned and operated by ByteDance and its subsidiaries. When TikTok shutdown operations in the US in January, Lemon8 was shutdown alongside the app. If TikTok shuts down again, Lemon8 likely will as well.

Should you download Lemon8?

Even with a shutdown looming, Lemon8 is free, so you can download and try the app now before the sale deadline. Just know the app’s posts resemble instructional guides more than memes to share, and many posts feel like advertisements.

What’s Lemon8’s privacy policy?

Most of Lemon8’s privacy policy seems standard for social media apps. It states Lemon8 collects personal and location information to provide you with a better app experience. Some collected information includes your IP address and browsing history. But part of the app’s privacy policy might raise eyebrows.

«The personal information we collect from you may be stored on a server located outside of the country where you live,» the policy reads. The company has servers around the world, according to the policy, so your information could be stored in any of them.

This is different from how Lemon8’s sister app TikTok stores some user’s data. The company stores US-based user data in Oracle servers. TikTok CEO Shou Chew said ByteDance employees in China can access this data, but with «robust cybersecurity controls and authorization approval» overseen by a US-based security team.

For more on the TikTok ban, here’s what to know about the Supreme Court’s decision, here’s what could happen next and here are other apps users are flocking to.

Technologies

Today’s NYT Connections: Sports Edition Hints and Answers for April 4, #193

Three of the four categories are especially tough today. Here are hints and the answers, for the NYT Connections: Sports Edition puzzle, No. 193, for April 4.

Looking for the most recent regular Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle and Strands puzzles.

I only solved one of the four categories for today’s Connections: Sports Edition on my own, so if you need help, you’re not alone.

The yellow category was pretty simple, but after that I couldn’t make any connections. It might help if you know a lot about a certain NBA player’s resume. Read on for hints and the answers.

Connections: Sports Edition is out of beta now, making its debut on Super Bowl Sunday, Feb. 9. That’s a sign that the game has earned enough loyal players that The Athletic, the subscription-based sports journalism site owned by the Times, will continue to publish it. It doesn’t show up in the NYT Games app but now appears in The Athletic’s own app. Or you can continue to play it free online.

Read more: NYT Connections: Sports Edition Puzzle Comes Out of Beta

Hints for today’s Connections: Sports Edition groups

Here are four hints for the groupings in today’s Connections: Sports Edition puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Do better.

Green group hint: March Madness.

Blue group hint: Six-time all-star.

Purple group hint: Think Wimbledon.

Answers for today’s Connections: Sports Edition groups

Yellow group: Not meeting expectations.

Green group: Teams in the Women’s Final Four.

Blue group: Teams Kawhi Leonard has played for.

Purple group: Ends in a piece of tennis equipment.

Read more: Wordle Cheat Sheet: Here Are the Most Popular Letters Used in English Words

What are today’s Connections: Sports Edition answers?

The yellow words in today’s Connections

The theme is not meeting expectations. The four answers are bust, disappointment, dud and failure.

The green words in today’s Connections

The theme is teams in the Women’s Final Four. The four answers are Bruins, Gamecocks, Huskies and Longhorns.

The blue words in today’s Connections

The theme is teams Kawhi Leonard has played for. The four answers are Aztecs, Clippers, Raptors and Spurs.

The purple words in today’s Connections

The theme is ends in a piece of tennis equipment. The four answers are bracket, eyeball, horseshoes and internet.

Quick tips for Connections: Sports Edition

#1: Don’t grab for the easiest group. For each word, think about other sports categories it might fit in – is this a word that can be used in football, or to describe scoring options?

#2: Second meanings are important. The puzzle loves to use last names and even college names that mean other things, to fool you into thinking they are words, not names.

#3: And the opposite is also true. Words like HURTS might seem like a regular word, but it’s also the last name of at least one pro athlete.

Technologies

Skip Your iPhone’s Lockscreen: Here’s the Hidden Flashlight Trick You Need to Know

A couple of taps can really make a difference on your iPhone.

Not long ago, your iPhone’s lockscreen would only allow two app shortcuts that you couldn’t change: camera controls and a flashlight toggle. However, iOS 18.2 allows you to customize these shortcuts to almost anything you might want. This small but impactful change is one of many ways iOS 18 supercharges customization for iPhone and iPad users. But what if you still want an easy-to-access way to toggle your flashlight without unlocking your phone?

Apple introduced an accessibility feature in iOS 14 that, once enabled, allows you to perform actions by just tapping on the back of your phone. The feature is called Tap Back and it remains a sleeper feature that’s sneakily hidden away in your settings menu. Enabling Tap Back essentially allows you to create a button on the back of your iPhone to perform an action without needing to take up any space.

Once you have Tap Back enabled, it doesn’t take long to see how much of a game-changer it can be with its added convenience. Below, we’ll show you how to set it up so a couple of taps on the back of your iPhone will let you launch just about anything you want.

For more, check out what’s in the latest iOS 18.4 release.

How to set up Back Tap on iPhone

Whether you want to link Back Tap with your flashlight, camera or launch a different iPhone app, the path through your iPhone settings begins the same way.

On your compatible iPhone (iPhone 8 or later), launch the Settings application and go to Accessibility > Touch > Back Tap. Now you have the option to launch your action (in this case, your flashlight) with either two or three taps. Although two taps is obviously faster, I would suggest three taps because if you fidget with your phone, it’s easy to accidentally trigger the accessibility feature.

Once you choose a tap option, select the Flashlight option — or a different action if you prefer. You’ll see over 30 options to choose from, including system options like Siri or taking a screenshot, to accessibility-specific functions like opening a magnifier or turning on real-time live captions. You can also set up Back Tap to open the Control Center, go back home, mute your audio, turn the volume up and down and run any shortcuts you’ve downloaded or created.

You’ll know you’ve successfully selected your choice when a blue checkmark appears to the right of the action. You could actually set up two shortcuts this way — one that’s triggered by two taps and one that’s triggered by three taps to the iPhone’s back cover.

Once you exit the Settings application, you can try out the newly enabled Back Tap feature by tapping the back of your iPhone — in my case, to turn on the flashlight. To turn off the flashlight, you can tap on the back of your iPhone as well, but you can also just turn it off from your lock screen if that’s easier.

For more great iPhone tips, here’s how to keep your iPhone screen from dimming all the time and canceling all those subscriptions you don’t want or need.