Technologies

Apple’s Mixed Reality Headset: What to Expect From WWDC’s Big Reveal

Long-awaited and still mysterious, Apple’s VR headset could be the spark for a whole new wave of hardware and software.

Apple’s next big product looks like it’ll cost $3,000, rest on your face and need to be tethered to a battery pack. Whatever this expected VR headset ends up being, it isn’t immediately clear what it’ll do or who it’s for. The Reality Pro headset, as it’s expected to be called when it’s likely unveiled at Apple’s WWDC developer conference on June 5, is Apple’s biggest new product in nearly a decade. It’s also totally different than anything Apple has ever made before.

VR headsets have been a standard consumer tech thing for years, and your family, or families you know, may already have one lying in a corner. They’re used for games, fitness, creative collaboration, even theater. Still, VR and AR have been outlier technologies, not deeply connected enough to the phones, tablets and laptops most of us use every day.

Apple could change that. And of course, don’t expect the word «metaverse» to be uttered even once. The metaverse became Meta’s buzzword to envision its future of AR and VR. Apple will have its own parallel, possibly unique, pitch.

A connection to everything?

I pair my Quest 2, from Meta, to my phone, and it gets my texts and notifications. I connect it to my Mac to cast extra monitors around my desk using an app called Immersed. But VR and AR don’t often feel deeply intertwined with the devices I use. They aren’t seamless in the way my watch feels when used with an iPhone, or AirPods feel when used with an iPad or Mac.

Apple needs this headset to bridge all of its devices, or at least make a good starting effort. Reports say the headset will run iPad apps on its built-in 4K displays, suggesting a common app ecosystem. It’s also possible that the Apple Watch could be a key peripheral, tracking fitness and also acting as a vibrating motion-control accessory.

VR is a self-contained experience, but mixed reality – which Apple’s headset should lean on heavily – uses pass-through cameras to blend virtual things with video of the real world. In Apple’s case, its own devices could act as spatially linked accessories, using keyboards and touchscreens and ways to show virtual screens springing from real ones.

Apple’s expected headset is supposed to be self-contained, a standalone device like the Quest 2 and Quest Pro. But that interconnectivity, and its position in Apple’s continuity-handoff connected ecosystem, is a big opportunity and a big question mark.

However, Apple does have a big AR head start: Its iOS ecosystem has supported AR for years, and the iPhone and iPad Pro already have depth-sensing lidar scanners that can map out rooms in ways that Apple’s headset should replicate. Apple could emphasize making its existing AR tools on other devices more usable and visible through a new interface.

Apple’s head of AR, Mike Rockwell – the person expected to be leading this new headset’s development – told me in a conversation about AR in 2020 that «AR has enormous potential to be helpful to folks in their lives across devices that exist today, and devices that may exist tomorrow, but we’ve got to make sure that it is successful. For us, the best way to do that is to enable our device ecosystem, so that it is a healthy and profitable place for people to invest their time and effort.»

Quest Pro VR headset, being worn while sitting at a desk — The Quest Pro and other headsets already support hand tracking. Will Apple refine the technology?

Meta

How do we control it?

I’m less curious about the Apple headset display – which sounds extremely promising with a possible 4K resolution per eye and a Micro OLED display – and more focused on how Apple solves what we do with our hands.

Interfaces in VR and AR are very much a work in progress. VR has tended to lean on split game controllers for most inputs, with optional (and steadily improving) hand tracking that still isn’t perfected.

Apple isn’t expected to have any controller at all with its Reality Pro headset. Instead, it’ll likely use both eye tracking and hand tracking to create a more accurate and possibly streamlined style of interface that could make targeting intended actions feel faster. Eye tracking already works this way, sometimes, in headsets that use it: The PlayStation VR 2 has some games that use eye tracking for controlling menus.

Accessibility is a big question here. Apple’s design choices are often very accessibility-conscious, and VR and AR headsets often rely on eye movement or physical hand movements that aren’t always easy for everyone. Voice control is a possible option here, or maybe some Apple Watch-connected functions that improve gesture accuracy and offer some touch controls could be in the cards, too. I don’t know. Apple already added some gesture controls for accessibility purposes on the Apple Watch, so the door’s open.

A lot of hand gestures in VR feel complicated to me, and involve lots of movement. Can Apple make a gesture language that feels as intuitive and as easy as multitouch on iPhones and iPads? It’s a big hurdle.

A woman wearing a VR headset punches an object, shattering it — Supernatural has been a popular VR fitness app for the Meta Quest 2 for years.

Within

Fitness focus

VR has already been a surprisingly effective fitness tool for years. Apple could address a whole bunch of opportunities that could open the landscape a lot further, though.

I’ve used Beat Saber and Supernatural on the Quest 2 for years as home exercise options, but the Quest 2 (and most VR headsets) aren’t designed with fitness in mind. Foam and silicone face pieces get sweaty, hardware can feel weirdly balanced, and no company has really spent targeted effort yet on making headgear that’s aimed at breathability and comfort like a piece of athletic equipment. There are plenty of third-party Quest accessories that help, but it still feels like an imperfect situation.

That’s Apple’s wheelhouse. After designing the Apple Watch, AirPods and, most recently, the Watch Ultra’s new straps, conceiving of materials and design that could feel better during workouts seems like an achievable goal. If the Reality Pro feels like a better piece of workout gear, it could inspire others to invest in better designs, too.

Apple should, and could, integrate the Apple Watch and fitness and health tracking into the headset’s functions. The Quest 2 can do this too to some degree, but most smartwatches and fitness trackers, like Fitbit, don’t have deep connections with VR headsets yet. They should, and again, introducing a clear wearable relationship between watch and headset feels like an overdue bridge.

Of all the things I’m trying to imagine Apple positioning an expensive headset to be in people’s lives, a fitness device keeps coming to mind as a much more likely proposition than a gaming gadget. Not that many people own gym equipment, or have space for it. Could headsets fill that role? I think they could. For me, they already do, sometimes.

Will Apple just focus on making it a great wearable display?

I’m starting to wonder if maybe Apple’s first goal with Reality Pro is just to nail a great audio/video experience. I’ve thought of VR/AR glasses as eventually needing to be «earbuds for your eyes,» as easy to use and as good as headphones are now. VR and AR headsets I’ve used all far short of being perfect displays, with the exception of the highly expensive Varjo XR-3. Could Apple achieve making the Reality Pro a headset that looks and sounds good enough to truly want to watch movies in?

Some reports that the Apple headset runs iPad apps, and that perhaps the iPad Pro with its lidar/camera array is in fact the «developer kit» for the headset, make me wonder if the headset will feel like a wearable extension of iOS rather than a whole new experience.

Inside a pair of VR goggles, showing lenses and a dial with numbers on the outside — The inside of the Vive XR Elite: prescription adjustments allow a wide range of vision to fit… but not as wide as mine.

Scott Stein/CNET

What about my glasses?

VR and AR headsets aren’t making it easy for me to live with my own eyewear. Some hardware fits right over my own chunky glasses, and some doesn’t. As headsets get smaller, a lot of them are trying to add vision-adjustment diopters right into the hardware – like the Vive XR Elite – or add optional prescription inserts.

Maybe someday we’ll have AR glasses that double as our own everyday glasses, and Apple can morph into a Warby Parker optical shop for its retail glasses fittings. In the meantime, these sometimes-on headsets also need to work without being annoying. Am I going to have to order prescription lenses? And how? And will they fit my needs? It’s a big responsibility for VR/AR manufacturers, and I’ve found that some of the insert options don’t meet my heavily near-sighted needs.

What are the killer apps?

Finally, of course, I’m curious about how this headset is defined. The Quest 2 is a game console with benefits. The Quest Pro was aimed at work. The PlayStation VR 2 is a PS5 extension.

The iPhone was a browser, an iPod, and an email device at first. The iPad wanted to be an easy way for users to read and look at the web. The Apple Watch was a fitness device, iPod, and wrist-communicator. What will Version One of the Apple Mixed Reality Headset be positioned as?

Apple did pepper a ton of extras into the Apple Watch at first, almost to test the waters with possibilities: a camera remote, a virtual way to send love taps and scribbles, voice memos. Reports of an avatar-based FaceTime, multiscreen immersive sports, and maybe 3D immersive versions of Apple’s already 3D-enabled Maps are clear starts. Apple’s collaborative Freeform app could be pitched as a mixed reality workplace, and movies could be watched in a virtual theater, in a way that VR headsets have enabled for years (but maybe here with an even better display and audio). AR-enabled iPhone and iPad home improvement apps, 3D scanning apps, and games could be ported over, leaning on similar lidar-scanning AR functions in-headset. Apple fitness workouts, clearly, could be big. Gaming? With Arcade, or some early partners, sure.

Will any of these be enough? Will Apple define a territory that right now has had a hard time defining itself beyond gaming? This first headset may not be the one most people buy, but it could be the one that tries to map out some clear directions for development beyond gaming. With Samsung and Google’s headset on the horizon, and possibly a lot more after that, these devices will start to reinvent themselves as they become more phone-connected and portable. Apple could have an early chance at shaping that narrative… or, if it doesn’t, others will get a chance after Apple. We’ll likely know more, or at least get an early glimpse, at WWDC.

Technologies

Here’s How a Former Overwatch Pro Made the Support Hero He Always Wanted

Scott «Custa» Kennedy used his experience as a former Overwatch League pro to design one of the game’s most popular heroes in Reign of Talon season 1.

Overwatch’s Reign of Talon season 1 is starting to wind down, and the biggest story has been the five new heroes who joined the roster. A lot of attention has understandably gone to Jetpack Cat, a hero once scrapped in the game’s early design, but resurrected on the cusp of the game’s 10th anniversary. She’s been the subject of bans and memery due to her unique kit that features permanent flight and the ability to fly any other hero through the air with her Lifeline ability.

But another support hero has quietly gone under the radar as one of the most-played characters in the new season: Mizuki.

Mizuki is a complex hero, similar on paper to support heroes Brigitte and Lucio, who mix damage with healing in the radius around them, but with his own unique mechanics. He has a constant healing aura around him, which grows more powerful as he deals damage with his weapon or uses other healing abilities. His main weapon is a projectile that bounces off surfaces. One of his abilities, Katashiro Return, offers a burst of movement, but also the ability to teleport back to your starting point within a few seconds.

That all adds up to a hero design that gives players lots of options but also requires you to carefully strategize to turn the tide of battle. Do you stay with your team to maximize the value of your healing aura? Or do you split from them for a higher-risk, higher-reward play? Do you use your Katashiro Return ability to flank behind an enemy team, or save it to disengage from an unexpected attack?

Despite spending most of my time in Overwatch playing support heroes, including Ana and Kiriko, I found Mizuki challenging early in the season, even as I watched enemy Mizukis pump out damage and secure clutch kills while constantly healing their teams.

This «unlockable challenge» element was an intentional part of Mizuki’s design, as I was soon to learn from chatting with the hero’s creator, a former Overwatch eSports pro.

By and large, support players have embraced this challenge. An Overwatch spokesperson told me via email that «Mizuki is consistently in the top four for all support picks in Season 1, across every region.» He’s one of several elements powering a revival of the game, along with a new ongoing story, weekly faction missions and the promise of more new heroes every season. People have flocked back into the game since the start of Season 1, with its average player count on Steam more than doubling over the past month.

Mizuki’s design was led by Scott «Custa» Kennedy, a longtime presence in Overwatch’s professional scene as both a player and match analyst, and now an associate hero designer. I spoke with Scott at Blizzard’s spotlight event and also spoke with him and Mizuki’s character artist, Melissa Kelly, in early March to discuss how they created one of the game’s most popular heroes.

From professional player to associate designer

After a few years as a professional player and several more as an analyst and caster for the Overwatch League, Kennedy was looking for the next step in his career.

«Overwatch [had] been my life for, like, the last 10 years in many different facets,» he said, but as he reached retirement age in the esports realm, he wanted a change. He spoke with some of the Overwatch developers, including associate game director Alec Dawson, about what it would take to get into game development.

After doing some QA work and hands-on game development («I made the world’s hardest 2D cat platformer in three days,» he said), Kennedy secured an associate hero designer opening for Overwatch, which was a perfect fit with his experience.

When given the task of envisioning the game’s next healer, Kennedy said he didn’t want to make another support designed around «point-and-shoot» mechanics that healed teammates and hurt enemies, like Ana or Juno.

«I wanted [Mizuki] to be more of an AoE healing aura-type hero because I think that’s something that’s been underrepresented in our heroes,» Kennedy said. Instead, he came up with the area-of-effect healing that’s similar to how Lucio and Brigitte heal, but with the added layer of that healing becoming more powerful the better you play in combat.

Managing that nuance was a learning experience for Kennedy.

«One of the biggest things that I learned is how complexity can be really cool on paper, but when you’re making a hero how quickly that snowballs into making a player overwhelmed,» Kennedy said. But he feels the team ultimately found a good balance, where inexperienced players can still contribute with him, while more experienced and skilled players can benefit even more.

Kelly added that Mizuki was a complicated hero on the design side, too.

«One of the issues is that he was looking kind of like a [damage hero],» she said. «He looked very aggressive for a healer. So we were just trying to soften him up.» Kelly pointed out that Mizuki’s weapon is a mix of a priest’s staff and a sickle, which also blurs the lines a bit between support and damage heroes.

That nuance seems to be a big part of Mizuki’s appeal. Even though I generally prefer the kind of «point-and-shoot» healing hero Kennedy said he wanted to avoid, I’ve found Mizuki to be one of the most interesting additions to the roster, especially among support heroes. His Binding Chain ability, which roots an enemy hit by the chain into place, rewards good aim and timely use, while his Healing Kasa and Katashiro Return abilities let my brain ponder over creative escapes and ambushes.

When I play Mizuki, I’m always thinking while I fight, and I enjoy feeling that kind of active engagement with the game.

Mizuki’s reception and prospects for pro play

Kennedy worried that players would be turned off by how complex the hero is — wondering, «Are players going to try him, not understand him and then be like… ‘I’m just gonna play the cat?'» (The cat, of course, is Jetpack Cat, who was released alongside Mizuki in season 1 and immediately became one of the most popular and most-banned heroes. She has a more intuitive, point-and-heal design, although her launch state also allows for particularly aggressive gameplay.)

Instead, Kennedy has enjoyed watching players stick with Mizuki and later post about how they’ve «unlocked» the hero by figuring out the formula to succeed with him. Kennedy said it’s rewarding to see players grasp his original concept for the hero as it plays out in-game. After that initial, somewhat disastrous first game I played, I started clicking with Mizuki, too.

Players still struggled with parts of Mizuki’s kit, and Kennedy noted some initial frustrations with «intentional design limitations» he and the team placed on the hero. Players seemed to want to use his Katashiro Return ability to go on aggressive flanks, but found it didn’t last long enough to successfully move behind enemy teams. That kind of larger repositioning would go against the design team’s vision for the hero, who is meant to stay near his team and use the ability to return to them quickly.

Now, Kennedy said, «players seem to understand the limitations of the hero, and that’s been cool to see.»

Mizuki has had a strong launch, and has been sitting around a 54% win rate in competitive modes since the start of the season. That’s quite high, ranking just behind last season’s top performer: the damage hero Vendetta. I asked Kennedy how he reads that data — whether Mizuki is overtuned or just a good fit among this season’s most-played heroes.

Kennedy said Mizuki was in a «pretty healthy» spot, but could get pulled down a bit in future seasons. «The numbers that he can put out in terms of healing and damage output are things that really put him above everyone else at this point. So it’s definitely something we’re keeping an eye on.»

But that power won’t necessarily translate to Mizuki being picked up in professional play, at least based on last month’s Overwatch Championship Series Bootcamp. Kennedy said the hero’s kit isn’t as good for staying alive and executing plays as heroes such as Lucio and Kiriko, who have long been must-picks in pro play.

«I could see Mizuki getting more playtime in a world in which we start playing more rush metas [centered around tanks like Ramattra or Orisa],» he said, «but with how fast the game is being played at the highest level, it can be difficult for Mizuki to keep up.»

Kennedy brought up one of Overwatch’s biggest and most inevitable challenges over its decade-long tenure: balancing heroes for both the pro level and the rest of the game, and how the difficulty lies in the fact that certain resources — such as speed boosts, mobility and burst damage — are more valuable at the highest levels of coordinated play. The design team is always working to make sure heroes are never totally out of balance at either skill level, he said.

That work has been on display since the launch of Season 1, with balance patches coming out virtually every week up through the midseason patch on March 10. Those updates mostly focused on the five new heroes but also included some changes to Vendetta, who continues to terrorize the game with a very strong win rate and the ability to cut someone down almost out of nowhere, leaving opponents very little time to react.

Still, the season overall has been a win for the game, thanks largely to the influx of new heroes and the different playstyles they add to the game.

«[I’m] definitely a little overwhelmed with how positive everyone has been with Mizuki — and honestly, the five heroes in general,» Kennedy said. «I think the reception’s been awesome. We couldn’t have asked for anything better.»

Technologies

Amazon’s Spring Sale Just Added a Ton of Gaming Deals. Here Are Our Favorites, Expiring Soon

Technologies

Today’s NYT Connections: Sports Edition Hints and Answers for March 30, #553

Here are hints and the answers for the NYT Connections: Sports Edition puzzle for March 30 No. 553.

Looking for the most recent regular Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle and Strands puzzles.

Today’s Connections: Sports Edition is a tough one. You’ll need to know a little about four very different sports in order to solve it. If you’re struggling with today’s puzzle, read on for hints and the answers.

Connections: Sports Edition is published by The Athletic, the subscription-based sports journalism site owned by The Times. It doesn’t appear in the NYT Games app, but it does in The Athletic’s own app. Or you can play it for free online.

Read more: NYT Connections: Sports Edition Puzzle Comes Out of Beta

Hints for today’s Connections: Sports Edition groups

Here are four hints for the groupings in today’s Connections: Sports Edition puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Make a racket.

Green group hint: Goooooal!

Blue group hint: Baseball stars.

Purple group hint: Toss the pigskin.