Technologies

The Revelation I Got From Experiencing HaptX Is Wild

I tested gloves and buzzing things in Las Vegas to see where the future points.

I put my hands out flat and loaded them into a pair of gloves loaded with joints, cables, pumps and tightening straps. All of this was connected to a backpack-size box that helped pump pressure around my fingers and create sensations of touching things. I was about to play Jenga in VR using an $80,000 pair of haptic gloves made by HaptX.

The future of the metaverse, or how we’ll dip into virtual worlds, seems to involve VR and AR, sometimes. If it does, it’ll also mean solving what we do with our hands. While companies like Meta are already researching ways that neural input bands and haptic gloves could replace controllers, none of that is coming for years. In the meantime, is there anything better than the VR game controllers already out there or basic camera-based hand tracking? I’ve tried a couple of haptic gloves before, but I was ready to try more.

I poked around CES 2023 in Las Vegas to get some experiences with devices I hadn’t tried before, and it suddenly hit me that there’s already a spectrum of options. Each of them was a little revelation.

High end: Massive power gloves

HaptX has been recognized for years as one of the best haptic gloves products on the market, but I’d never had a chance to experience them. The hardware is highly specialized and also extremely large and expensive. I wish I’d gotten a chance to see them at the last CES I attended before this, in 2020. Finally, in 2023, I got a chance.

The gloves use microfluidics, pumping air into small bladders that create touch sensations in 133 zones per hand across the fingers and palm. At the same time, cables on the backs of the fingers pull back to simulate up to 8 pounds of force feedback. Used with apps that support them, you can reach out, grab things and actually feel them.

I’ve tried lower-cost haptic gloves at home that didn’t have the air bladders but did have cables to apply resistance. The HaptX gloves are a big step forward and the most eerily realistic ones I’ve ever tried. I wouldn’t say everything «felt real,» but the poking finger-feelings I had in my fingers and palms let me feel shapes of things, while the resistance gave me a sense of grabbing and holding stuff.

The most amazing moments were when I placed objects on my palm and seemed to feel their weight. Also, when another person’s finger virtually touched mine. Another journalist was in another VR headset with haptic gloves playing Jenga next to me. We never made contact, but occasionally we shook hands virtually or gave high-fives. Our fingers touching felt… well, oddly real, like sensing someone’s finger touching your glove.

HaptX is making another pair of smaller, more mobile gloves later this year that cost less (about $5,000) while still promising the same level of feedback, plus tactile vibrations like the haptic buzzes you might feel with game controllers. I didn’t get to demo that, but I can’t wait.

While HaptX’s tech is wild, it’s meant for industrial purposes and simulations. It represents actual reality, but it’s so massive that it wouldn’t let me do anything else other than live in its simulated world. For instance, how would I type or pull out my phone? Still, I’ll dream of interfaces that let me feel as immersed as these gloves can accomplish.

Budget gloves: bHaptics’ TactGloves

At $300, bHaptics‘ yellow haptic gloves are far, far less expensive than HaptX. They’re also completely different. Instead of creating pressure or resistance, all they really do is have various zones inside that electrically buzz, like your phone, watch or game controller, to sync up with moments when your fingers in VR would virtually touch something. Strangely, it’s very effective. In a few demos I tried, pushing buttons and touching objects provided enough feedback to feel like I was really «clicking» a thing. Another demo, which had me hug a virtual avatar mirroring my movements or shake hands, gave enough contact to fool me into feeling I was touching them.

bHaptics also makes a haptic vest I tried called the TactSuit that vibrates with feedback with supported games and apps. There aren’t many apps that work ideally with haptic gloves right now, because no one’s using haptic gloves. But bHaptics’ support of the standalone Meta Quest 2, and its wireless Bluetooth pairing, means they’re actually portable… even if they look like giant janitorial cleaning gloves. The tradeoff with being so small and wireless is their range is short. I had to keep the gloves within about two feet of the headset, otherwise they’d lose connection.

The buzzing feedback didn’t prove to me that I could absolutely reach into other worlds, but they offered enough sensation to make hand tracking feel more precise, Instead of wondering whether my hand gestures had actually contacted a virtual object, I could get a buzzing confirmation. The whole experience reminded me of some sort of game controller feedback I could wear on my fingers, in a good way.

No gloves at all: Ultraleap’s Ultrasonics

Ultraleap, a company that’s specialized in hand tracking for years, has a different approach to haptics: sensations you can feel in the air. I waved my hand above a large rectangular panel and felt ripples and buzzes beneath my fingers. The feelings are created with ultrasonic waves, high-powered sound bursts that move air almost like super-precise fans against your fingers. I tried Ultraleap’s tech back in 2020, but trying the latest and more compact arrays this year made me think about a whole new use case. It was easy to make this logic leap, since Ultraleap’s booth also demonstrated hand tracking (without haptic feedback) on Pico Neo 3 and Lynx R1 VR and mixed reality headsets.

What if… this air vibration could be used for headsets? Ultraleap is already dreaming and planning for this solution, but right now ultrasonic tech is too power hungry, and the panels too large, for headgear. The tech is mainly being used in car interface concepts, where the hand gestures and feedback could make adjusting car controls while driving easier to use and less dangerous or awkward. The range of the sensations, at least several feet, seem ideal for the arm length and radius of most existing camera-based hand-tracking tech being used right now on devices like the Meta Quest 2.

I tried a demo where I adjusted a virtual volume slider by pinching and raising the volume up and down, while feeling discrete clicks to let me know I was doing something. I could feel a virtual «bar» in the air that I could feel and perhaps even move. The rippling, subtle buzzes are far more faint than those on haptic gloves or game controllers (or your smartwatch), but they could be just enough to give that extra sense that a virtual button press, for instance, actually succeeded…or that a gesture to turn something on or off was registered.

If these interfaces move to VR and AR, Ultreleap’s representatives said they’d likely end up in larger installations first: maybe theme park rides. Ultraleap’s tech is already in experiences like the hands-free Ninjago ride at Legoland, which I’ve tried with my kids. The 3D hand-tracking ride lets me throw stars at enemies, but sometimes I’m not sure my gestures were registered. What if buzzing let me know I was making successful hits?

Haptics are likely to come from stuff we already wear

Of course, I skipped the most obvious step for AR and VR haptic feedback: smartwatches and rings. We wear buzzing things on our wrists already. Apple’s future VR/AR device might work with the Apple Watch this way, and Meta, Google, Samsung, Qualcomm and others could follow a similar path with dovetailing products. I didn’t come across any wearable watch or ring VR/AR haptics at CES 2023 (unless I missed them). But I wouldn’t be surprised if they’re coming soon. If AR and VR are ever going to get small enough to wear more often, we’re going to need controls that are far smaller than game controllers… and ways to make gesture inputs feel far less weird. Believe the buzz: Haptics is better than you think.

Technologies

Here’s How a Former Overwatch Pro Made the Support Hero He Always Wanted

Scott «Custa» Kennedy used his experience as a former Overwatch League pro to design one of the game’s most popular heroes in Reign of Talon season 1.

Overwatch’s Reign of Talon season 1 is starting to wind down, and the biggest story has been the five new heroes who joined the roster. A lot of attention has understandably gone to Jetpack Cat, a hero once scrapped in the game’s early design, but resurrected on the cusp of the game’s 10th anniversary. She’s been the subject of bans and memery due to her unique kit that features permanent flight and the ability to fly any other hero through the air with her Lifeline ability.

But another support hero has quietly gone under the radar as one of the most-played characters in the new season: Mizuki.

Mizuki is a complex hero, similar on paper to support heroes Brigitte and Lucio, who mix damage with healing in the radius around them, but with his own unique mechanics. He has a constant healing aura around him, which grows more powerful as he deals damage with his weapon or uses other healing abilities. His main weapon is a projectile that bounces off surfaces. One of his abilities, Katashiro Return, offers a burst of movement, but also the ability to teleport back to your starting point within a few seconds.

That all adds up to a hero design that gives players lots of options but also requires you to carefully strategize to turn the tide of battle. Do you stay with your team to maximize the value of your healing aura? Or do you split from them for a higher-risk, higher-reward play? Do you use your Katashiro Return ability to flank behind an enemy team, or save it to disengage from an unexpected attack?

Despite spending most of my time in Overwatch playing support heroes, including Ana and Kiriko, I found Mizuki challenging early in the season, even as I watched enemy Mizukis pump out damage and secure clutch kills while constantly healing their teams.

This «unlockable challenge» element was an intentional part of Mizuki’s design, as I was soon to learn from chatting with the hero’s creator, a former Overwatch eSports pro.

By and large, support players have embraced this challenge. An Overwatch spokesperson told me via email that «Mizuki is consistently in the top four for all support picks in Season 1, across every region.» He’s one of several elements powering a revival of the game, along with a new ongoing story, weekly faction missions and the promise of more new heroes every season. People have flocked back into the game since the start of Season 1, with its average player count on Steam more than doubling over the past month.

Mizuki’s design was led by Scott «Custa» Kennedy, a longtime presence in Overwatch’s professional scene as both a player and match analyst, and now an associate hero designer. I spoke with Scott at Blizzard’s spotlight event and also spoke with him and Mizuki’s character artist, Melissa Kelly, in early March to discuss how they created one of the game’s most popular heroes.

From professional player to associate designer

After a few years as a professional player and several more as an analyst and caster for the Overwatch League, Kennedy was looking for the next step in his career.

«Overwatch [had] been my life for, like, the last 10 years in many different facets,» he said, but as he reached retirement age in the esports realm, he wanted a change. He spoke with some of the Overwatch developers, including associate game director Alec Dawson, about what it would take to get into game development.

After doing some QA work and hands-on game development («I made the world’s hardest 2D cat platformer in three days,» he said), Kennedy secured an associate hero designer opening for Overwatch, which was a perfect fit with his experience.

When given the task of envisioning the game’s next healer, Kennedy said he didn’t want to make another support designed around «point-and-shoot» mechanics that healed teammates and hurt enemies, like Ana or Juno.

«I wanted [Mizuki] to be more of an AoE healing aura-type hero because I think that’s something that’s been underrepresented in our heroes,» Kennedy said. Instead, he came up with the area-of-effect healing that’s similar to how Lucio and Brigitte heal, but with the added layer of that healing becoming more powerful the better you play in combat.

Managing that nuance was a learning experience for Kennedy.

«One of the biggest things that I learned is how complexity can be really cool on paper, but when you’re making a hero how quickly that snowballs into making a player overwhelmed,» Kennedy said. But he feels the team ultimately found a good balance, where inexperienced players can still contribute with him, while more experienced and skilled players can benefit even more.

Kelly added that Mizuki was a complicated hero on the design side, too.

«One of the issues is that he was looking kind of like a [damage hero],» she said. «He looked very aggressive for a healer. So we were just trying to soften him up.» Kelly pointed out that Mizuki’s weapon is a mix of a priest’s staff and a sickle, which also blurs the lines a bit between support and damage heroes.

That nuance seems to be a big part of Mizuki’s appeal. Even though I generally prefer the kind of «point-and-shoot» healing hero Kennedy said he wanted to avoid, I’ve found Mizuki to be one of the most interesting additions to the roster, especially among support heroes. His Binding Chain ability, which roots an enemy hit by the chain into place, rewards good aim and timely use, while his Healing Kasa and Katashiro Return abilities let my brain ponder over creative escapes and ambushes.

When I play Mizuki, I’m always thinking while I fight, and I enjoy feeling that kind of active engagement with the game.

Mizuki’s reception and prospects for pro play

Kennedy worried that players would be turned off by how complex the hero is — wondering, «Are players going to try him, not understand him and then be like… ‘I’m just gonna play the cat?'» (The cat, of course, is Jetpack Cat, who was released alongside Mizuki in season 1 and immediately became one of the most popular and most-banned heroes. She has a more intuitive, point-and-heal design, although her launch state also allows for particularly aggressive gameplay.)

Instead, Kennedy has enjoyed watching players stick with Mizuki and later post about how they’ve «unlocked» the hero by figuring out the formula to succeed with him. Kennedy said it’s rewarding to see players grasp his original concept for the hero as it plays out in-game. After that initial, somewhat disastrous first game I played, I started clicking with Mizuki, too.

Players still struggled with parts of Mizuki’s kit, and Kennedy noted some initial frustrations with «intentional design limitations» he and the team placed on the hero. Players seemed to want to use his Katashiro Return ability to go on aggressive flanks, but found it didn’t last long enough to successfully move behind enemy teams. That kind of larger repositioning would go against the design team’s vision for the hero, who is meant to stay near his team and use the ability to return to them quickly.

Now, Kennedy said, «players seem to understand the limitations of the hero, and that’s been cool to see.»

Mizuki has had a strong launch, and has been sitting around a 54% win rate in competitive modes since the start of the season. That’s quite high, ranking just behind last season’s top performer: the damage hero Vendetta. I asked Kennedy how he reads that data — whether Mizuki is overtuned or just a good fit among this season’s most-played heroes.

Kennedy said Mizuki was in a «pretty healthy» spot, but could get pulled down a bit in future seasons. «The numbers that he can put out in terms of healing and damage output are things that really put him above everyone else at this point. So it’s definitely something we’re keeping an eye on.»

But that power won’t necessarily translate to Mizuki being picked up in professional play, at least based on last month’s Overwatch Championship Series Bootcamp. Kennedy said the hero’s kit isn’t as good for staying alive and executing plays as heroes such as Lucio and Kiriko, who have long been must-picks in pro play.

«I could see Mizuki getting more playtime in a world in which we start playing more rush metas [centered around tanks like Ramattra or Orisa],» he said, «but with how fast the game is being played at the highest level, it can be difficult for Mizuki to keep up.»

Kennedy brought up one of Overwatch’s biggest and most inevitable challenges over its decade-long tenure: balancing heroes for both the pro level and the rest of the game, and how the difficulty lies in the fact that certain resources — such as speed boosts, mobility and burst damage — are more valuable at the highest levels of coordinated play. The design team is always working to make sure heroes are never totally out of balance at either skill level, he said.

That work has been on display since the launch of Season 1, with balance patches coming out virtually every week up through the midseason patch on March 10. Those updates mostly focused on the five new heroes but also included some changes to Vendetta, who continues to terrorize the game with a very strong win rate and the ability to cut someone down almost out of nowhere, leaving opponents very little time to react.

Still, the season overall has been a win for the game, thanks largely to the influx of new heroes and the different playstyles they add to the game.

«[I’m] definitely a little overwhelmed with how positive everyone has been with Mizuki — and honestly, the five heroes in general,» Kennedy said. «I think the reception’s been awesome. We couldn’t have asked for anything better.»

Technologies

Amazon’s Spring Sale Just Added a Ton of Gaming Deals. Here Are Our Favorites, Expiring Soon

Technologies

Today’s NYT Connections: Sports Edition Hints and Answers for March 30, #553

Here are hints and the answers for the NYT Connections: Sports Edition puzzle for March 30 No. 553.

Looking for the most recent regular Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle and Strands puzzles.

Today’s Connections: Sports Edition is a tough one. You’ll need to know a little about four very different sports in order to solve it. If you’re struggling with today’s puzzle, read on for hints and the answers.

Connections: Sports Edition is published by The Athletic, the subscription-based sports journalism site owned by The Times. It doesn’t appear in the NYT Games app, but it does in The Athletic’s own app. Or you can play it for free online.

Read more: NYT Connections: Sports Edition Puzzle Comes Out of Beta

Hints for today’s Connections: Sports Edition groups

Here are four hints for the groupings in today’s Connections: Sports Edition puzzle, ranked from the easiest yellow group to the tough (and sometimes bizarre) purple group.

Yellow group hint: Make a racket.

Green group hint: Goooooal!

Blue group hint: Baseball stars.

Purple group hint: Toss the pigskin.