Technologies

Apple Vision Pro’s Biggest Missing Pieces

Commentary: Apple’s AR/VR «spatial computer» pushes the upper limits of immersive tech. But it has some notable omissions.

The evolution of VR and AR is in major flux, and right now Apple’s bleeding-edge, ultra-expensive Vision Pro headset is sitting at the top of the heap — and it’s not even expected to arrive until 2024.

After a demo at WWDC, I came away instantly impressed at how the Vision Pro hardware synthesized so much of what I’ve seen in VR and AR over the last five years. But this time it was all done with Retina Display-level resolution and smooth, easy hand-tracking finesse. At $3,499 (around £2,800 or AU$5,300 converted), Apple’s hardware is priced far beyond VR headsets like the Meta Quest 2, and also aims to be a full computer experience in AR (as well as VR, even though Apple doesn’t outright acknowledge it).

Even so, there are notable absences from the Vision Pro, at least based on what Apple presented at WWDC. I had expectations as to what Apple might make the killer apps and features for its spatial computer headset, and only some of them materialized. Maybe others will emerge as we get closer to Apple’s 2024 headset release, or get introduced via software updates much like Meta has done with the Quest over time.

Still, I’m surprised they’re not already part of the Vision Pro experience. To me, they’ll eventually make everything I saw work even better.

Read more: Best VR Headsets of 2023

Fitness

The Meta Quest’s best feature, other than games, is its ability to be a portable exercise machine. Beat Saber was my pandemic home workout, and Meta’s acquisition of Within (maker of Supernatural, a subscription fitness app that pairs with the Apple Watch) indicates how much fitness is already a part of the VR landscape.

Apple is a prime candidate to fuse VR, AR, fitness and health and take the experience far beyond what Meta has done. Apple already has the Apple Watch and Apple Health and Fitness Plus subscription workouts. And yet, the Vision Pro has no announced fitness or health apps yet, except for a sitting-still Meditation app that’s more of a breathing prompt.

Apple Watch Ultra — When will the Apple Watch become part of the Vision Pro experience?

James Martin/CNET

Even more puzzling: The Vision Pro seemingly doesn’t work with the Apple Watch at all. This could change. Maybe Apple is waiting to discuss this aspect next year. Or, maybe, it will arrive with a future version of the Vision hardware.

Some VR sporting game app makers are already announcing ports for the Vision Pro, including Golf Plus, an app that works in VR with controllers. The assumption, for now, is that these apps will find a way to work just using eye and hand tracking.

Apple didn’t even demonstrate that much active motion inside the Vision Pro; my demos were mostly seated, except for a final walk-around experience where I looked at a dinosaur up close.

Is the dangling battery pack part of the concern? The headset’s weight? Or is Apple starting with computing interfaces first and adding fitness later?

iPhone 14 Pro vs. iPhone 13 Pro — The iPhone in your pocket should ideally interface with Vision Pro, too.

Lexy Savvides/CNET

iPhone, iPad and Watch compatibility

Speaking of fitness and the Apple Watch, I always imagined Apple’s AR headset would emphasize seamless compatibility with all of its products. Apple didn’t exactly do that with the Vision Pro, either.

The Vision Pro will work as a monitor-extending device with Macs, providing high-res virtual displays in a similar way that headsets like the Quest 2, Quest Pro and others already do. I didn’t get to try using the Vision Pro with a Mac, and I didn’t get to use a trackpad or keyboard, either. The Vision Pro will work with Magic Trackpads and Magic Keyboards to add physical trackpad/typing input options, again, like other VR/AR headsets, in addition to onboard eye- and hand-tracking.

And yet, the Vision Pro won’t interface directly with iPhones, iPads or the Apple Watch. Not yet, at least.

The Vision Pro primarily runs iPad-type apps. This is why the iPad Pro seems to be the best computer companion to the Vision Pro: it has a keyboard, a trackpad, built-in motion tracking that’s already AR-friendly, front and rear depth-sensing cameras that could possibly help with 3D scanning environments or faces, and it has a touchscreen and Pencil stylus.

A man with AR glasses on, holding a phone, seeing a floating window with a person speaking to him — Qualcomm’s software tools for AR glasses extend phone apps to headsets. The Apple Vision Pro bypasses the phone and works on its own.

Qualcomm

Apple is emphasizing that the Vision Pro is a self-contained computer that doesn’t need other devices. That’s understandable, and most of Apple’s cloud services, like FaceTime, will work so that the Vision Pro will essentially absorb most iPhone and iPad features. Yet I don’t understand why iPhones, iPads and Watches wouldn’t be welcome input accessories. Their touchscreens and motion controls could help them act as remotes or physical-feedback devices, in a similar way to how Qualcomm is already looking at the relationship between phones and AR glasses. I hold up my iPhone all the time to enter passwords on the Apple TV. I seamlessly drop photos, links and text from my iPhone over to my Mac.

Touchscreens could act as virtual keyboards. Drawing on the iPad could mirror a 3D art interface. With Apple’s already excellent passthrough cameras, iPhone, iPad and Watch displays could become interactive second screens, tactile interfaces that sprout extra parts in AR. Also, there’s the value of haptics and physical feedback.

Sony Playstation VR 2 virtual reality headset — The PSVR 2 controller: One advantage to physical devices is physical feedback.

James Martin/CNET

No haptics

The buzzing, tapping and rumbling feelings we get on our phones, watches and game controllers, those are feedback tools I’ve really connected with when I go into VR. The PlayStation VR 2 even has rumbling feedback in its headset. The Vision Pro, with eye and hand tracking, has no controllers. And no haptic feedback. I’ve been fascinated by the future of haptics — I saw a lot of experimental solutions earlier this year. For now, Apple is sitting out on haptic solutions for Vision Pro.

When I use iPhones and the Watch, I feel those little virtual clicks as reminders of when I’ve opened something, or when information comes in. I feel them as extensions of my perceptual field. In VR, it’s the same way. Apple’s pinch-based hand tracking technically has some physical sensation when your own fingers touch each other, but nothing will buzz or tap to let you know something is happening beyond your field of view — in another open app, for instance, or behind you in an immersive 3D environment.

Microsoft made a similar decision with the HoloLens by only having in-air hand tracking, but former AR head Alex Kipman told me years ago that haptics were part of the HoloLens roadmap.

Apple already has haptic devices; the Apple Watch, for example. All those iPhones, too. I’m surprised the Vision Pro doesn’t already have a solution for haptics. But maybe it’s also on its roadmap?

logitech-vr-ink-lifestyle-final — Logitech’s VR Ink, released in 2019, is an in-air 3D stylus. How will Apple handle creative tools in 3D?

Logitech

Will there ever be other accessories like the Pencil?

One of the wildest parts about a mixed-reality future is how it can blend virtual and real tools together, or even invent tools that don’t exist. I’ve had my VR controllers act like they’re morphing into objects that feel like they’re an extension of my body. Some companies like Logitech have already developed in-air 3D styluses for creative work in VR and AR.

Apple’s Vision Pro demos didn’t show off any creative apps beyond the collaborative Freeform, and nothing that showed how 3D inputs could be improved with handheld tools.

Maybe Apple is starting off by emphasizing the power of just eyes and hands here, similar to how Steve Jobs initially refused to give the iPad a stylus. But the iPad has a Pencil now, and it’s an essential art tool for many people. Dedicated physical peripherals are helpful, and Apple has none with its Vision Pro headset (yet). I do like VR controllers, and Meta’s clever transforming Quest Pro controllers can be flipped around to become writing tools with an added stylus tip. As a flood of creative apps arrive on the Vision Pro in 2024, will Apple address possibilities for dedicated accessories? Will the Vision Pro allow for easy pairing of them? Hopefully, yes.

The Apple Vision Pro is a long way from arriving, and there’s still so much we don’t know. As Apple’s first AR/VR headset evolves, however, these key aspects should be kept in mind, because they’ll be incredibly important ways to expand how the headset feels useful and flexible for everyone.

Technologies

CNET Debates: Is Apple’s New Crossbody Strap a Great Idea or a Terrible One?

Does the crossbody strap make it more or less likely that you’ll have your iPhone stolen? We have conflicting opinions.

One thing you can be sure of during an Apple event is that it will generate immense quantities of discourse among CNET’s seasoned nerds — and no, we don’t always agree with one another.

Is the iPhone Air totally pointless and uncalled for, or the best design innovation since very thinly sliced bread? Both can be true, depending on whom you ask.

Among the many announcements on Tuesday that sparked conflicting opinions was a crossbody strap for the iPhone. After a back-and-forth in Slack, my colleague Zach McAuliffe and I have decided to put forth our respective viewpoints and allow you to be the judge.

Don’t miss any of our unbiased tech content and lab-based reviews. Add CNET as a preferred Google source.

Great idea: Katie Collins, Principal Writer

Have you ever been walking down the street to meet your friend, navigating using Google maps and texting your pal to let them know you’re running late, when all of sudden: bam! A dude on a moped has whizzed past at high speed and removed your phone from your hand before you’ve even had a chance to realize what’s happened?

In London, this style of phone theft is a daily occurrence, and while it’s never happened to me personally, every time I step foot on the streets of the British capital, I’m immediately wary and vigilant.

Earlier this year, the Guardian reported that survey data from American insurance company SquareTrade showed that 39% of all European phone theft take place in the UK, and that 42% of British phone thefts occur in London. So common is it for your phone to be snatched by someone on a bike or moped that London’s Metropolitan Police issue special prevention guidance, featuring advice such as: «[when using your phone,] stand away from the roadside, close to a building or wall, so no one can come up behind you.»

I get that a crossbody is not a failsafe method to prevent iPhone theft. I would never advise someone to walk around a city in a state of blissful ignorance while their phone flaps hands-free against their body. But I do endorse it as a way to fend off opportunists on two wheels.

I can see other times the crossbody strap would come in handy, too. Frequently on my travels, I find myself on a boat, clutching the railing and taking pictures on my phone as the world passes me by. Always in these situations I’m concerned that just one clumsy slip could see my precious phone go the way of the Heart of the Ocean in Titanic. A crossbody strap would provide peace of mind in such moments to protect me against my own idiocy.

As a clumsy person who dreads having their phone stolen, I will be investing in one of Apple’s crossbody iPhone straps the moment they become available. I personally can only see the benefit in having my phone glued to my body as well as my hand.

Terrible idea: Zach McAuliffe, Staff Writer

When I saw Apple’s new crossbody strap for the iPhone, my first thought was, «I bet someone could cut that real easily and steal someone’s iPhone.»

But surely Apple thought of that and chose a cut-resistant strap made with something like Dyneema, right? Nope. According to Apple, the strap is made of recycled PET (polyethylene terephthalate) yarns. If you’re unfamiliar with this kind of yarn, it’s a synthetic fiber made from recycled plastic bottles.

If you had a razor or something similarly sharp, you could cut through the strap like a hot knife through butter. Then there’s nothing stopping you from taking the iPhone. The decision to dangle a thousand-dollar device off a strip of non-cut-resistant plastic gives me so much anxiety.

Some people on Reddit said they’ve had their crossbody bags and purses stolen because someone cut the straps and ran or rode off, so it does happen. Granted, so does someone snatching a phone from your hand. But if I’m wearing my iPhone as a bag, I’m advertising that I have an iPhone and all you have to do is follow me for a second in order to cut the straps and take off with it.

Plus, if I’m my iPhone is tethered to me by a strap, I might be more cavalier with how I handle it. The strap and corresponding case are meant to keep the device safe, so I might take for granted things that could damage it out in the world. What if a car kicks a rock up and hits it, or I bump into a metal railing a little too hard or any number of things happen and my iPhone gets a new scratch or breaks?

No, I’d much rather grip my iPhone like my life depends on it when the device is in my hand. And then I’ll slip my iPhone into my pocket for safe keeping like Bilbo Baggins after he finds the One Ring.

The crossbody strap is a bad idea. I know people have things taken all the time, but the strap is like wearing a sign around your neck that you have an iPhone and with a quick snip it could be yours! Hopefully Apple will make a cut-resistant strap in the future.

For more from Apple’s event, check out all the announcements and our hands-on with the ultra-thin iPhone Air.

Technologies

Today’s NYT Connections: Sports Edition Hints and Answers for Sept. 10, #352

Here are hints and the answers for the NYT Connections: Sports Edition puzzle for Sept. 10, No. 352

Looking for the most recent regular Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle and Strands puzzles.

Today’s Connections: Sports Edition is a tough one. But if you’re a shoe junkie, you might ace the blue category. If you’re struggling but still want to solve it, read on for hints and the answers.

Connections: Sports Edition is published by The Athletic, the subscription-based sports journalism site owned by the Times. It doesn’t show up in the NYT Games app but appears in The Athletic’s own app. Or you can play it for free online.

Read more: NYT Connections: Sports Edition Puzzle Comes Out of Beta

Hints for today’s Connections: Sports Edition groups

Here are four hints for the groupings in today’s Connections: Sports Edition puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Baseball grouping.

Green group hint: You might do this to a door.

Blue group hint: Just do it.

Purple group hint: Not real coaches, but…

Answers for today’s Connections: Sports Edition groups

Yellow group: NL East teams.

Green group: Synonyms of slam, in basketball.

Blue group: Nike shoes.

Purple group: Actors who played football coaches.

Read more: Wordle Cheat Sheet: Here Are the Most Popular Letters Used in English Words

What are today’s Connections: Sports Edition answers?

The yellow words in today’s Connections

The theme is NL East teams. The four answers are Atlanta, Miami, New York and Philadelphia.

The green words in today’s Connections

The theme is synonyms of slam, in basketball. The four answers are drunk, flush, jam and stuff.

The blue words in today’s Connections

The theme is Nike shoes. The four answers are Blazer, Cortez, Pegasus and Shox.

The purple words in today’s Connections

The theme is actors who played football coaches. The four answers are Pacino, Thornton, Washington and Winkler.

Technologies

Today’s NYT Strands Hints, Answers and Help for Sept. 10

Here are hints and answers for the NYT Strands puzzle for Sept. 10, No. 556

Looking for the most recent Strands answer? Click here for our daily Strands hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle, Connections and Connections: Sports Edition puzzles.

Today’s NYT Strands puzzle has a fun, timely theme. Once you figure out the topic, the answers come easily. If you need hints and answers, read on.

I go into depth about the rules for Strands in this story.

If you’re looking for today’s Wordle, Connections and Mini Crossword answers, you can visit CNET’s NYT puzzle hints page.

Read more: NYT Connections Turns 1: These Are the 5 Toughest Puzzles So Far

Hint for today’s Strands puzzle

Today’s Strands theme is: Keep it classy.

If that doesn’t help you, here’s a clue: School days.

Clue words to unlock in-game hints

Your goal is to find hidden words that fit the puzzle’s theme. If you’re stuck, find any words you can. Every time you find three words of four letters or more, Strands will reveal one of the theme words. These are the words I used to get those hints but any words of four or more letters that you find will work:

HOLE, DOLE, SCENE, SCENES, CURE, CURES, SLIM, SLIME, SLIMED, NICE

Answers for today’s Strands puzzle

These are the answers that tie into the theme. The goal of the puzzle is to find them all, including the spangram, a theme word that reaches from one side of the puzzle to the other. When you have all of them (I originally thought there were always eight but learned that the number can vary), every letter on the board will be used. Here are the nonspangram answers: