Technologies

Apple Should Build Their AR on the Meta Quest

Commentary: Its glasses may be on hold, but the immediate future is already in front of us.

Apple’s first-ever VR-AR or «mixed reality» device is expected this year, and already its follow-up product seems to be on hold. According to Bloomberg’s reliable Mark Gurman, a planned set of AR glasses isn’t coming from Apple anytime soon. That’s OK: AR glasses don’t seem like they’re imminent from anyone.

After a trip to Las Vegas to try out some of the emerging technologies around future VR and AR headsets, one thing is increasingly clear: Everyone’s trying to figure out AR glasses, but everyone’s trying to perfect VR headsets. The difference between those two scenarios is bigger than you think.

All-day AR glasses that are useful, work convincingly, have long enough battery life, work with your phone and function as actually legit prescription glasses haven’t materialized, although the pieces are coming into place. Companies like Meta have promised a decade-long path to these glasses. It turns out, maybe, that’s going to be the case for everyone else, too. I’ve seen smart glasses that look real but don’t do much, or glasses with AR that feel chunky and do some things, but don’t quite work with my vision and can’t figure out how to work with my phone yet. Chipmaker Qualcomm is working on this; Google, Apple and Samsung need to solve it someday, too.

In the meantime, VR already has a very real and reasonably popular product that most families I know in the everyday world are familiar with: the Meta (formerly Oculus) Quest 2.

That recognition is no small thing. I think of the Quest’s place in everyday life like the Amazon Echo was years ago: something odd that over time became familiar, normalized. Something reasonably priced, and good enough to do a few things actually well. The Quest 2 is basically a game console. Where Meta has struggled is figuring out how to expand that base beyond gamers.

Following Meta’s playbook is something I expected Apple would do. Heck, I expect most companies are going to do it. The Quest 2 works just like most people imagine it will, or better. It’s a bit of instant magic that’s totally wire-free.

The Quest 2 does have downsides. In fact, those problems emerge the more you use it. I find connecting with friends and social spaces gets weird and buggy, prone to lag, disconnects and way-too-basic avatars. The battery life is bad. For fitness apps, which the Quest 2 can do surprisingly well, it’s still not good at really managing sweat or keeping my glasses from fogging.

Even though Meta wants the Quest 2 and higher-end, work-focused Quest Pro to open up new ways to work by creating virtual monitors around my laptop, the connections and display quality aren’t good enough to be more than a clever experiment most of the time. I can see my laptop keyboard with the Quest Pro’s passthrough cameras, but typing feels awkward and nowhere near as good as when I’m just on my laptop… and I can’t see my phone screen to check messages, either. The Quest can show me phone notifications like a basic smartwatch from a decade ago, but I can’t interact with them.

These VR headsets can even do some basic AR, using passthrough cameras that «mix reality» to show the real world in fuzzier video, with VR layered on top. The effect is sometimes pretty amazing, and could even approach feelings I’ve had with early AR headsets like the Microsoft HoloLens 2.

So where does that put Apple? Clearly, there’s a headset coming soon. And according to Bloomberg’s Gurman, the next goal after this first expensive headset is to work on a more affordable model. It’s like Meta’s approach to the Quest and Quest Pro, in reverse. And there are plenty of things Apple could focus on to make its entry into VR (and AR) worth the effort.

Better comfort, better fitness

The Quest 2 is already an affordable fitness device, and pairs with watches to show heart rate and fitness stats. Apple clearly has an advantage on time spent developing the Apple Watch, fitness and health tracking, and its Fitness Plus subscription video workouts, which also have overlaid fitness stats.

Apple could emphasize workouts and fitness on its headset, with comfortable, breathable straps and face pieces that could feel better for exercise. Meta is starting to realize it needs to improve comfort for VR: A recent Razer partnership using head straps made by CPAP-maker ResMed shows a need for better materials. I’d expect Apple to make this aspect a key part of the headset’s advantages. There are other advantages, too. Apps like Beat Saber and Supernatural use music for fitness, and Apple already has all of Apple Music at its disposal.

Connect better with laptops, iPads, phones, watches

VR headsets right now have an extremely hard time working well with all the other things we have lying around us. I can’t get a Quest to connect nicely with my phone all the time. To work with my laptop, I need a specialized third-party app with its own thing I have to install on my laptop and turn on.

Meanwhile, Apple has been focusing on handoffs and continuity across AirPods, HomePods, iPhones, Apple Watches, MacBooks, Apple TVs… all over the place. That’s what’s needed to make a VR headset seem seamless and integrated into other stuff. I want to check my watch in VR, or use it to control apps. Or use my phone, and also see the phone. Suddenly grab my laptop, and the headset connects. Incoming calls? No problem. Send myself things back and forth from my phone or laptop and get all the files and things I want, and not feel like I’m on a vacation from them. That’s what Apple’s headset could set out to achieve.

That’s a best-case scenario. Much like the first Apple Watch and iPhone, the actual Day 1 functions of this headset might end up disappointing.

Better social

Even though the metaverse is on everyone’s minds, there aren’t many big social spaces in VR that work well. Microsoft’s Altspace is nice, but often feels empty. VRChat is wild, experimental, full of big features and ideas, and feels like a messy explosion that’s hard to jump into. Meta can’t get enough people into Horizon Worlds. Even when these platforms do work, for concerts or events, the limits on people who can attend at once, the lag and drop-off, not to mention the avatar limits, make it a trade-off versus any other way you could connect on a phone or laptop.

Apple may not be able to solve this any better for larger-scale experiences, but for more intimate and several-person FaceTime-like moments, Apple could make shared experiences in VR work a lot better. Meta hasn’t perfected social VR yet, and someone needs to.

Can Apple make a better controller? (Or none?)

The Quest 2 controllers are fine, but all of VR leans on the same game controller-like inputs for headsets. Apple’s headset could lean more on hand tracking, or wearable inputs like the Apple Watch. I’m curious if a more work-oriented controller or accessory can be created that makes the headset feel better for taking on apps beyond games. Meta’s working on a long-term, game-changing shift to neural input wristbands eventually, but it’s unclear whether this approach will end up succeeding.

The Quest platform has continually improved its hand tracking over the years. However, hand tracking’s reliance on particular gestures without any physical feedback is an imperfect solution right now. Maybe Apple tries hand tracking along with using an Apple Watch or the iPhone for tactile haptic feedback, or finds a smaller go-between accessory.

I’ve been trying out experimental haptic technology recently, trying to imagine how VR could think its way to new inputs. This headset feels like the biggest opportunity Apple’s ever faced to create a brand-new type of input device that could make a big impact on the landscape. If it’s done right, maybe it’ll be the input accessory that makes its future AR glasses, whenever they arrive, seem feasible.

Build out more interesting mixed reality

For all the Meta Quest Pro promises to blend AR and VR with its mixed-reality capabilities, not many apps tap into its extras yet. I’ve seen some mind-blowing demos of mixed reality in VR with the ultra-high-end Varjo XR-3 connected to a PC, which at least showed me ways that a VR headset could begin to feel like a portal interconnected to my own home reality. Apple could start experimenting with more engaging AR moments in a high-end VR headset, and at least get the ball rolling on things that work in advance of whenever its AR glasses are ready, years from now.

Smaller sessions in VR may make more sense right now

VR is a thing I don’t use all the time, and that’s true for most people. Maybe that’s exactly where Apple should start. It’s not a given we’ll want to wear AR glasses everywhere, or even what those glasses would be good for. In the meantime, a VR headset at home that’s meant to be worn sometimes, but not all the time, is the place most of us feel safest to start. It’s why the Quest is something people actually use.

It’s also a way to avoid dealing with questions of accommodating true prescription vision needs in everyday glasses, something no one’s succeeded in tackling, either. VR headsets sometimes need prescription inserts, but many just fit right over the glasses we already have. I prefer the easy-fit solution: I don’t need to make VR a thing I spend a whole day in. I’ll settle for a truly useful hour or two, and if Apple can make that hour or two even better than what we have now, that’s a big enough step forward for me.

Editor’s note, Jan. 20: Adds mention of Meta’s hand tracking for the Quest.

Technologies

Today’s NYT Mini Crossword Answers for Monday, May 19

Here are the answers for The New York Times Mini Crossword for May 19.

Looking for the most recent Mini Crossword answer? Click here for today’s Mini Crossword hints, as well as our daily answers and hints for The New York Times Wordle, Strands, Connections and Connections: Sports Edition puzzles.

Today’s NYT Mini Crossword is pretty easy. 5-Across, «one for whom every day is Boxing Day,» stumped me because I really wanted the answer to have something to do with cats. (Spoiler: It did not.) Need some help with today’s Mini Crossword? Read on. And if you could use some hints and guidance for daily solving, check out our Mini Crossword tips.

The Mini Crossword is just one of many games in the Times’ games collection. If you’re looking for today’s Wordle, Connections, Connections: Sports Edition and Strands answers, you can visit CNET’s NYT puzzle hints page.

Read more: Tips and Tricks for Solving The New York Times Mini Crossword

Let’s get at those Mini Crossword clues and answers.

Mini across clues and answers

1A clue: Network satirized on «30 Rock,» for short
Answer: NBC

4A clue: Sport played on horseback
Answer: POLO

5A clue: One for whom every day is Boxing Day?
Answer: MOVED

6A clue: Like correct letters in Wordle
Answer: GREEN

7A clue: Blend together
Answer: MELD

Mini down clues and answers

1D clue: «Invisible Man» or «Little Women»
Answer: NOVEL

2D clue: Run in the wash
Answer: BLEED

3D clue: What bourbon whiskey is primarily made from
Answer: CORN

4D clue: Tiny hole in the skin
Answer: PORE

5D clue: Longtime movie studio acquired by Amazon in 2022
Answer: MGM

How to play more Mini Crosswords

The New York Times Games section offers a large number of online games, but only some of them are free for all to play. You can play the current day’s Mini Crossword for free, but you’ll need a subscription to the Times Games section to play older puzzles from the archives.

Technologies

Today’s NYT Connections: Sports Edition Hints and Answers for May 19, #238

Hints and answers for the NYT Connections: Sports Edition puzzle, No. 238, for May 19.

Looking for the most recent regular Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle and Strands puzzles.

Connections: Sports Edition might be tough today if, like me, you don’t know what «loge» means. Read on for hints and the answers.

Connections: Sports Edition is out of beta now, making its debut on Super Bowl Sunday, Feb. 9. That’s a sign that the game has earned enough loyal players that The Athletic, the subscription-based sports journalism site owned by the Times, will continue to publish it. It doesn’t show up in the NYT Games app but now appears in The Athletic’s own app. Or you can continue to play it free online.

Read more: NYT Connections: Sports Edition Puzzle Comes Out of Beta

Hints for today’s Connections: Sports Edition groups

Here are four hints for the groupings in today’s Connections: Sports Edition puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Brag.

Green group hint: Where’s my seat?

Blue group hint: City that never sleeps.

Purple group hint: Opposite of go.

Answers for today’s Connections: Sports Edition groups

Yellow group: Boast

Green group: Stadium seating sections

Blue group: New York Knicks

Purple group: ____ stop

Read more: Wordle Cheat Sheet: Here Are the Most Popular Letters Used in English Words

What are today’s Connections: Sports Edition answers?

The yellow words in today’s Connections

The theme is boast. The four answers are crow, gloat, grandstand and showboat.

The green words in today’s Connections

The theme is stadium seating sections. The four answers are bleacher, loge, suites and upper deck.

The blue words in today’s Connections

The theme is New York Knicks. The four answers are Bridges, Hart, McBride and Towns.

The purple words in today’s Connections

The theme is ____ stop. The four answers are back, jump, pit and short.

Technologies

Blade Runner: 18-Rotor «Volocopter» Moving from Concept to Prototype

It may look "nutty" and like a "blender," but the designers say the craft could challenge helicopters

Inventor and physicist Thomas Senkel created an Internet sensation with the October 2011 video of his maiden—and only—test flight of a spidery proof-of-concept 16-rotor helicopter dubbed Multicopter 1. Now the maker of the experimental personal aviation craft, the European start-up e-volo, is back with a revised «volocopter» design that adds two more rotors, a serial hybrid drive and long-term plans for going to 100 percent battery power.

The new design calls for 1.8-meter, 0.5-kilogram carbon-fiber blades, each paired with a motor. They are arrayed around a hub in two concentric circles over a boxy one- or two-person cockpit.

After awarding the volocopter concept a Lindbergh Prize for Innovation in April, Yolanka Wulff, executive director of The Charles A. and Anne Morrow Lindbergh Foundation, admitted the idea of the multi-blade chopper at first seems «nutty.» Looking beyond the novel appearance, however, she says, e-volo’s concept excels in safety, energy efficiency and simplicity, which were the bases of the prize.

All three attributes arrive thanks largely to evolo’s removal of classic helicopter elements. First, the energy-robbing high-mass main rotor, transmission, tail boom and tail rotor are gone. The enormous blades over a normal chopper’s cabin create lift, but their mass creates a high degree of stress and wear on the craft. And the small tail rotor, perched vertically out on a boom behind the cabin, keeps the helicopter’s body from spinning in the opposite direction as the main blades, but it also eats up about 30 percent of a helicopter’s power.

The volocopter’s multiple rotor blades individually would not create the torque that a single large rotor produces, and they offer redundancy for safety. Hypothetically, the volocopter could fly with a few as 12 functioning rotors, as long as those rotors were not all clustered together on one side, says Senkel, the aircraft’s co-inventor and e-volo’s lead construction engineer.

Without the iconic two-prop configuration, the craft would be lighter, making it more fuel efficient and reducing the physical complexity of delivering power to the top and rear blades from a single engine. Nor would the volocopter need an energy-hungry transmission. In fact, «there will be no mechanical connection between the gas engine and the blades,» Senkel says. That means fewer points of energy loss and more redundancy for safety.

E-volo’s design eliminates the dependence on a single source of power to the blades. As a serial-hybrid vehicle, the volocopter would have a gas-fueled engine, in this case an engine capable of generating 50- to 75 kilowatts, typical of ultralight aircraft. Rather than mechanically drive the rotors, the engine would generate power for electric motors as well as charge onboard lithium batteries. Should it fail, the batteries are expected to provide enough backup power so the craft could make a controlled landing.

Whereas helicopters navigate by changing the pitch of the main and tail rotor blades, the volocopter’s maneuverability will depend on changing the speed of individual rotors. Although more complex, it is more precise in principle to control a craft using three to six redundant microcontrollers (in case one or more fails) interpreting instructions from a pilot using a game console–like joystick—instead of rudder pedals, a control stick and a throttle.

Wulff’s first impression about the volocopter’s design is not uncommon. E-volo’s computer-animated promotional videos of a gleaming white, carbon-fiber and fiberglass craft beneath a thatch of blades recall the many-winged would-be flying machines of the late 19th century. This point is not lost on Senkel.

«I understand these skeptical opinions,» he says. «The design concept looks like a blender. But we really are making a safe flying machine.»

That would be progress in itself. Multicopter 1 looked like something from an especially iffy episode of MacGyver, complete with landing gear that involved a silver yoga ball. Senkel rode seated amid all those rotors powered only by lithium batteries. Multicopter 1 generated an average of 20 kilowatts for hovering and was aloft for just a few minutes.

There’s a reason why the experimental craft flew briefly and only once.Senkel describes that first craft as «glued and screwed together.» Seated on the same platform as the spinning blades, he says, «I was aware of the fact that I will be dead, maybe. Besides, we showed that the concept works. What do we win if we fly it twice?» he asks rhetorically.

Other than putting the pilot safely below the blades, the revised volocopter design would operate largely the same as the initial prototype. The design calls for three to six redundant accelerometers and gyroscopes to measure the volocopter’s position and orientation, creating a feedback loop that gives the craft stability and makes it easier to fly, Senkel says.

The volocopter’s revised prototype under construction could debut as soon as next spring. The first production models, available in perhaps three years, are expected to fly for at least an hour at speeds exceeding 100 kilometers per hour and a minimum altitude of about 2,000 meters, still far shy of standard helicopter’s normal operating altitude of about 3,000 meters. «This could change our lives, but I don’t expect anything like that for 10 years,» Senkel adds.

Given that most of the technology needed to build the volocopter is already available, «this idea is fairly easy to realize,» says Carl Kühn, managing director of e-volo partner Smoto GmbH, a company that integrates electric drive systems and related components.

Like Senkel, Kühn has modest short-term expectations despite his repeated emphasis on the standard nature of the technology involved. «I guess that e-volo will have [a prototype] aircraft in three years that can do the job—that it will lift one or two persons from one point to another,» he says.

The biggest immediate limitations appear to be regulatory. For instance, European aviation regulators consider any electrical system greater than 60 volts to be high voltage and regulate such systems more aggressively, Kühn says. As a result, the volocopter will operate below that threshold. The craft will also need to weigh no more than 450 kilograms to remain in the ultralight category, which is likewise subject to fewer government aviation regulations, according to Senkel.

The Lindbergh Foundation’s Wulff says the organization’s judges felt e-volo had «a greater than 50 percent chance of succeeding, or they wouldn’t have given them the innovation award.» Asked if she would line up to fly one someday, she says, «I sure would. It looks very compelling to me.»