Technologies
Apple Vision Pro’s Biggest Missing Pieces
Commentary: Apple’s AR/VR “spatial computer” pushes the upper limits of immersive tech. But it has some notable omissions.
The evolution of VR and AR is in major flux, and right now Apple’s bleeding-edge, ultra-expensive Vision Pro headset is sitting at the top of the heap — and it’s not even expected to arrive until 2024.
After a demo at WWDC, I came away instantly impressed at how the Vision Pro hardware synthesized so much of what I’ve seen in VR and AR over the last five years. But this time it was all done with Retina Display-level resolution and smooth, easy hand-tracking finesse. At $3,499 (around ÂŁ2,800 or AU$5,300 converted), Apple’s hardware is priced far beyond VR headsets like the Meta Quest 2, and also aims to be a full computer experience in AR (as well as VR, even though Apple doesn’t outright acknowledge it).
Even so, there are notable absences from the Vision Pro, at least based on what Apple presented at WWDC. I had expectations as to what Apple might make the killer apps and features for its spatial computer headset, and only some of them materialized. Maybe others will emerge as we get closer to Apple’s 2024 headset release, or get introduced via software updates much like Meta has done with the Quest over time.
Still, I’m surprised they’re not already part of the Vision Pro experience. To me, they’ll eventually make everything I saw work even better.
Read more:Â Best VR Headsets of 2023
Fitness
The Meta Quest’s best feature, other than games, is its ability to be a portable exercise machine. Beat Saber was my pandemic home workout, and Meta’s acquisition of Within (maker of Supernatural, a subscription fitness app that pairs with the Apple Watch) indicates how much fitness is already a part of the VR landscape.
Apple is a prime candidate to fuse VR, AR, fitness and health and take the experience far beyond what Meta has done. Apple already has the Apple Watch and Apple Health and Fitness Plus subscription workouts. And yet, the Vision Pro has no announced fitness or health apps yet, except for a sitting-still Meditation app that’s more of a breathing prompt.Â
When will the Apple Watch become part of the Vision Pro experience?
Even more puzzling: The Vision Pro seemingly doesn’t work with the Apple Watch at all. This could change. Maybe Apple is waiting to discuss this aspect next year. Or, maybe, it will arrive with a future version of the Vision hardware.
Some VR sporting game app makers are already announcing ports for the Vision Pro, including Golf Plus, an app that works in VR with controllers. The assumption, for now, is that these apps will find a way to work just using eye and hand tracking.
Apple didn’t even demonstrate that much active motion inside the Vision Pro; my demos were mostly seated, except for a final walk-around experience where I looked at a dinosaur up close.
Is the dangling battery pack part of the concern? The headset’s weight? Or is Apple starting with computing interfaces first and adding fitness later?
The iPhone in your pocket should ideally interface with Vision Pro, too.
iPhone, iPad and Watch compatibility
Speaking of fitness and the Apple Watch, I always imagined Apple’s AR headset would emphasize seamless compatibility with all of its products. Apple didn’t exactly do that with the Vision Pro, either.
The Vision Pro will work as a monitor-extending device with Macs, providing high-res virtual displays in a similar way that headsets like the Quest 2, Quest Pro and others already do. I didn’t get to try using the Vision Pro with a Mac, and I didn’t get to use a trackpad or keyboard, either. The Vision Pro will work with Magic Trackpads and Magic Keyboards to add physical trackpad/typing input options, again, like other VR/AR headsets, in addition to onboard eye- and hand-tracking.
And yet, the Vision Pro won’t interface directly with iPhones, iPads or the Apple Watch. Not yet, at least.
The Vision Pro primarily runs iPad-type apps. This is why the iPad Pro seems to be the best computer companion to the Vision Pro: it has a keyboard, a trackpad, built-in motion tracking that’s already AR-friendly, front and rear depth-sensing cameras that could possibly help with 3D scanning environments or faces, and it has a touchscreen and Pencil stylus.
Qualcomm’s software tools for AR glasses extend phone apps to headsets. The Apple Vision Pro bypasses the phone and works on its own.
Apple is emphasizing that the Vision Pro is a self-contained computer that doesn’t need other devices. That’s understandable, and most of Apple’s cloud services, like FaceTime, will work so that the Vision Pro will essentially absorb most iPhone and iPad features. Yet I don’t understand why iPhones, iPads and Watches wouldn’t be welcome input accessories. Their touchscreens and motion controls could help them act as remotes or physical-feedback devices, in a similar way to how Qualcomm is already looking at the relationship between phones and AR glasses. I hold up my iPhone all the time to enter passwords on the Apple TV. I seamlessly drop photos, links and text from my iPhone over to my Mac.
Touchscreens could act as virtual keyboards. Drawing on the iPad could mirror a 3D art interface. With Apple’s already excellent passthrough cameras, iPhone, iPad and Watch displays could become interactive second screens, tactile interfaces that sprout extra parts in AR. Also, there’s the value of haptics and physical feedback.
The PSVR 2 controller: One advantage to physical devices is physical feedback.
No haptics
The buzzing, tapping and rumbling feelings we get on our phones, watches and game controllers, those are feedback tools I’ve really connected with when I go into VR. The PlayStation VR 2 even has rumbling feedback in its headset. The Vision Pro, with eye and hand tracking, has no controllers. And no haptic feedback. I’ve been fascinated by the future of haptics — I saw a lot of experimental solutions earlier this year. For now, Apple is sitting out on haptic solutions for Vision Pro.
When I use iPhones and the Watch, I feel those little virtual clicks as reminders of when I’ve opened something, or when information comes in. I feel them as extensions of my perceptual field. In VR, it’s the same way. Apple’s pinch-based hand tracking technically has some physical sensation when your own fingers touch each other, but nothing will buzz or tap to let you know something is happening beyond your field of view — in another open app, for instance, or behind you in an immersive 3D environment.
Microsoft made a similar decision with the HoloLens by only having in-air hand tracking, but former AR head Alex Kipman told me years ago that haptics were part of the HoloLens roadmap.Â
Apple already has haptic devices; the Apple Watch, for example. All those iPhones, too. I’m surprised the Vision Pro doesn’t already have a solution for haptics. But maybe it’s also on its roadmap?Â
Logitech’s VR Ink, released in 2019, is an in-air 3D stylus. How will Apple handle creative tools in 3D?
Will there ever be other accessories like the Pencil?
One of the wildest parts about a mixed-reality future is how it can blend virtual and real tools together, or even invent tools that don’t exist. I’ve had my VR controllers act like they’re morphing into objects that feel like they’re an extension of my body. Some companies like Logitech have already developed in-air 3D styluses for creative work in VR and AR.
Apple’s Vision Pro demos didn’t show off any creative apps beyond the collaborative Freeform, and nothing that showed how 3D inputs could be improved with handheld tools.Â
Maybe Apple is starting off by emphasizing the power of just eyes and hands here, similar to how Steve Jobs initially refused to give the iPad a stylus. But the iPad has a Pencil now, and it’s an essential art tool for many people. Dedicated physical peripherals are helpful, and Apple has none with its Vision Pro headset (yet). I do like VR controllers, and Meta’s clever transforming Quest Pro controllers can be flipped around to become writing tools with an added stylus tip. As a flood of creative apps arrive on the Vision Pro in 2024, will Apple address possibilities for dedicated accessories? Will the Vision Pro allow for easy pairing of them? Hopefully, yes.
The Apple Vision Pro is a long way from arriving, and there’s still so much we don’t know. As Apple’s first AR/VR headset evolves, however, these key aspects should be kept in mind, because they’ll be incredibly important ways to expand how the headset feels useful and flexible for everyone.
Technologies
Trump Maintains US‑Iran Negotiations Continue Amid Tehran’s Denials of Duplicity
President Trump insists that US‑Iran talks are ongoing despite Tehran’s denial of any negotiation plans, while warning that only a deal or total surrender will allow passage through the Strait of Hormuz. Conflicting statements from both sides have heightened uncertainty as the conflict enters its sixth month.
On Monday, President Donald Trump asserted that negotiations between the United States and Iran are still taking place, even after Tehran stated it has no intention of engaging in direct talks with Washington.
In a fiery Truth Social post, Trump labeled Iran’s leaders “unbelievably duplicitous,” claiming they are lying about ongoing peace talks “whether Iran wants to admit it or not.” He repeated his assertion that the United States completely controls the Strait of Hormuz, despite maritime traffic through the crucial route lingering at only a small fraction of pre‑conflict levels.
He wrote, “Nothing reaches Iran unless we allow it, and nothing will pass unless a deal—or total surrender—is achieved.”
Earlier that day, Iranian Foreign Ministry spokesperson Esmail Baghaei told reporters there is no imminent plan for U.S.–Iran negotiations, contradicting Trump’s earlier comment that talks would resume Monday afternoon. Baghaei added that Iran’s only current discussions are with Oman concerning the Strait of Hormuz.
The conflicting statements have heightened uncertainty over the peace‑talk process and the broader conflict, now in its sixth month.
Trump’s assertion about new negotiations came a day after he said on Truth Social that he had agreed to cancel a massive strike against Iran “subject to being able to rapidly make a DEAL.” He said in the same post that Iran and other Middle Eastern countries had asked him to hold off on that attack because “the perimeters of a deal has been agreed to.”
Trump has claimed dozens of times throughout the more‑than‑five‑month‑long war that a deal is at hand. No permanent deal has been signed, and a temporary ceasefire reached in June has fallen apart.
Trump has also repeatedly threatened to launch devastating strikes against Iran before backing off. After the latest example, oil prices on Monday fell and stocks surged.
BMI, a research unit of Fitch Solutions, said in a note Monday that a broader diplomatic understanding on reopening the Strait of Hormuz is still achievable this quarter, while raising the probability of its escalation scenario to 35% from 25%, citing mounting military, diplomatic and economic signs of rising U.S.-Iran tensions.
“Diplomatic progress is likely to be punctuated by periodic military flare-ups, while miscalculation by either side could trigger a renewed escalation,” BMI analysts wrote in a note. The firm said the key issue to watch is the future governance of the strait, as the Iran-Oman talks — potentially backed by Gulf states, China and the U.S. — point to efforts to build a post-conflict shipping framework.
Shipping risks persist even as diplomacy appears to be advancing. The United Kingdom Maritime Trade Operations Centre said it received a report of an incident 20 nautical miles (23 miles) northeast of Khasab, Oman — at the mouth of the strait — with a tanker’s master reporting an explosion in close proximity to the vessel at about 20:37 UTC Sunday (4:37 pm ET). The vessel and crew were safe and authorities are investigating, UKMTO said, advising ships to transit with caution.
The proposal Trump announced over the weekend calls for the U.S. and Iran to return to negotiations and continue ironing out some of the thorny issues that had derailed diplomatic efforts, according to The Associated Press, citing a regional official involved in the mediation efforts.
The official said the proposal also includes a reopening of the Hormuz Strait and halting attacks across the region, including by Iranian-backed militias in Iraq on the Arab Gulf countries and Jordan.
The U.S., for its part, will end its naval blockade on Iran and allow Tehran to export its oil, the official said, adding that no deal has been reached, although the mediation efforts remained underway.
Trump’s weekend reversal has lowered the temperature after days of escalating attacks across the Gulf. Kuwait said Saturday that Iranian forces launched a wave of drones within its airspace, with its military destroying multiple aircraft after Iran targeted critical infrastructure in the country’s north.
A parallel track with Muscat is also advancing. Iranian diplomats said Tehran was close to reaching a new arrangement with Oman to manage shipping through the Strait of Hormuz, a deal critical to preventing the war from escalating further, according to the Financial Times.
Iranian officials said negotiations over future management of the Hormuz Strait with Oman, which sits on the opposite shore of the waterway, are in their final stages. The agreed shipping route would be different from those used before, according to Iran’s Foreign Ministry spokesperson, Baghaei, adding that the new route was separate from the issue of the strait’s reopening or continued closure.
Technologies
Oil Prices Slide as Trump Halts Planned Iran Strike
Oil prices dropped after Trump cancelled a planned strike on Iran, with WTI down about 5% and Brent near 5% lower. He said the move followed requests from Tehran and regional allies for a pause while a deal shaping the Strait of Hormuz and Iran’s nuclear program is negotiated.
Oil prices fell on Monday after President Donald Trump announced he had cancelled a planned strike on Iran. WTI futures dropped roughly 5% to $80.34 a barrel, while Brent slipped about 4.7% to $83.77 a barrel.
Trump said early Sunday he called off the strike after Iran and several Middle Eastern nations asked him to hold off, noting that the outlines of a deal had been agreed upon. He added that the prospective accord would entail the immediate, full opening of the Strait of Hormuz and an end to Iran’s nuclear ambitions, according to his Truth Social post.
The president had been considering another round of strikes as diplomatic hopes waned since the conflict began on February 28. He said the U.S. and Iran would meet for talks on Monday, but Iran denied any scheduled negotiations with Washington, citing PressTV. Iran’s foreign‑ministry spokesperson Esmaeil Baghaei clarified that Tehran was only discussing shipping routes through the Strait of Hormuz with Oman. In a follow‑up Truth Social message, Trump insisted that, regardless of Iran’s acknowledgment, the United States is indeed discussing a solution to a long‑standing problem created by Iran.
Technologies
Oil Prices Drop as Trump Cancels Planned Attack on Iran
Oil prices fell sharply after President Trump announced the cancellation of a planned strike on Iran, citing a new deal that would open the Hormuz Strait and end Iran’s nuclear threat.
Oil prices fell sharply on Monday after President Donald Trump announced that he had called off a planned strike on Iran.
West Texas Intermediate futures, the U.S. benchmark, slipped roughly 5% to close at $80.34 per barrel, while Brent crude, the international benchmark, declined 4.7% to settle at $83.77 a barrel.
Trump made the announcement early Sunday, saying he had canceled the strike following requests from Tehran and other Middle Eastern countries.
In a Truth Social post, he wrote: “We have just been asked by Iran, and other Middle Eastern Countries, to hold off any attack in that the perimeters of a deal has been agreed to.”
The president indicated that the proposed agreement would include the immediate, complete, and total opening of the Hormuz Strait, as well as an end to Iran’s nuclear threat.
Trump had been weighing additional strikes amid diminishing prospects for a diplomatic resolution to the conflict that began on Feb. 28. He stated that the U.S. and Iran would hold negotiations on Monday.
Tehran denied that talks were planned with Washington, according to state news outlet PressTV.
Iran’s Foreign Ministry spokesman Esmaeil Baghaei said Tehran was only holding talks with Oman regarding the routes ships can use through the Strait of Hormuz.
In a subsequent Truth Social post, Trump added that whether “Iran wants to admit it or not, we are, in fact, talking of a solution to a problem that they have caused for decades.”
-
Technologies4 years agoTech Companies Need to Be Held Accountable for Security, Experts Say
-
Technologies3 years agoBest Handheld Game Console in 2023
-
Technologies5 years agoBlack Friday 2021: The best deals on TVs, headphones, kitchenware, and more
-
Technologies3 years agoTighten Up Your VR Game With the Best Head Straps for Quest 2
-
Technologies5 years agoGoogle to require vaccinations as Silicon Valley rethinks return-to-office policies
-
Technologies5 years agoVerum, Wickr and Threema: next generation secured messengers
-
Technologies4 years agoThe number of Сrypto Bank customers increased by 10% in five days
-
Technologies5 years agoOlivia Harlan Dekker for Verum Messenger