Connect with us

Technologies

Apple Vision Pro Hands-On: Far Better Than I Was Ready For

I experienced incredible fidelity, surprising video quality and a really smooth interface. Apple’s first mixed-reality headset nails those, but lots of questions remain.

I was in a movie theater last December watching Avatar: The Way of Water in 3D, and I said to myself: “Wow, this is an immersive film I’d love to watch in next-gen VR.” That’s exactly what I experienced in Apple’s Vision Pro headset, and yeah, it’s amazing.

On Monday, I tried out the Vision Pro in a series of carefully picked demos during WWDC at Apple’s Cupertino, California, headquarters. I’ve been using cutting-edge VR devices for years, and I found all sorts of augmented reality memories bubbling up in my brain. Apple’s compact — but still not small —headset reminds me of an Apple-designed Meta Quest Pro. The fit of the back strap was comfy yet stretchy, with a dial to adjust the rear fit and a top strap for stability. The headset’s sleek design, and even its glowing front faceplate, also gave me an instant Ready Player One vibe. 

vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png
Watch this: Apple Vision Pro: I Tried Apple’s AR/VR Headset

05:35

I couldn’t wear my glasses during the demo, though, and neither will you. Apple’s headset does not support glasses, instead relying on Zeiss custom inserts to correct wearers’ vision. Apple did manage, through a setup process, to easily find lenses that fit my vision well enough so that everything seemed crystal clear, which is not an easy task. Also, we adjusted the fit and tuned spatial audio for my head using an iPhone, a system that will be finessed when the headset is released in 2024.

From there, I did my demos seated, mostly, and found myself surprised from the start. The passthrough video camera quality of this headset is good —really, really good. Not as good as my own vision, but good enough that I could see the room well, see people in it with me, see my watch notifications easily on my wrist. The only headset that’s done this previously was the extremely impressive but PC-connected Varjo XR-3, and Apple’s display and cameras feel even better.

Apple’s floating grid of apps appears when I press the top digital crown, which autocenters the home screen to wherever I’m looking. I set up eye tracking, which worked like on many other VR headsets I’ve used: I looked at glowing dots as musical notes played, and got a chime when it all worked.

An app menu in Apple's VisionOS. An app menu in Apple's VisionOS.

A list of apps as they would appear inside of the Apple Vision Pro headset.

Apple/Screenshot by CNET

From there, the interface was surprisingly fluid. Looking at icons or interface options slightly enlarges them, or changes how bold they appear. Tapping with my fingers while looking at something opens an app. 

I’ve used tons of hand-tracking technology on headsets like the HoloLens 2 and the Meta Quest 2 and Pro, and usually there’s a lot of hand motion required. Here, I could be really lazy. I pinched to open icons even while my hand was resting in my lap, and it worked. 

Scrolling involves pinching and pulling with my fingers; again, pretty easy to do. I resized windows by moving my hand to throw a window across the room or pin it closer to me. I opened multiple apps at once, including Safari, Messages and Photos. It was easy enough to scroll around, although sometimes my eye tracking needed a bit of extra concentration to pull off.

Apple’s headset uses eye tracking constantly in its interface, something Meta’s Quest Pro and even the PlayStation VR 2 don’t do. That might be part of the reason for the external battery pack. The emphasis on eye tracking as a major part of the interface felt transformative, in a way I expected might be the case for VR and AR years ago. What I don’t know is how it will feel in longer sessions.

I don’t know how the Vision Pro will work with keyboards and trackpads, since I didn’t get to demo the headset that way. It works with Apple’s Magic Keyboard and Magic Trackpad, and Macs, but not with iPhone and iPad or Watch touchscreens —not now, at least.

Dialing in reality

I scrolled through some photos in Apple’s preset photo album, plus a few 3D photos and video clips shot with the Vision Pro’s 3D camera. All the images looked really crisp, and a panoramic photo that spread around me looked almost like it was a window on a landscape that extended just beyond the room I was in. 

Apple has volumetric 3D landscapes on the Vision Pro that are immersive backgrounds like 3D wallpaper, but looking at one really shows off how nice that Micro OLED display looks. A lake looked like it was rolling up to a rocky shore that ended right where the real coffee table was in front of me. 

man using keyboard to work using apple vision pro headset man using keyboard to work using apple vision pro headset

Raising my hands to my face, I saw how the headset separates my hands from VR, a trick that’s already in Apple’s ARKit. It’s a little rough around the edges but good enough. Similarly, there’s a wild new trick where anyone else in the room can ghost into view if you look at them, a fuzzy halo with their real passthrough video image slowly materializing. It’s meant to help create meaningful contact with people while wearing the headset. I wondered how you could turn that off or tune it to be less present, but it’s a very new idea in mixed reality.

Apple’s digital crown, a small dial borrowed from the Apple Watch, handles reality blend. I could turn the dial to slowly extend the 3D panorama until it surrounded me everywhere, or dial it back so it just emerged a little bit like a 3D window. 

Mixed reality in Apple’s headset looks so casually impressive that I almost didn’t appreciate how great it was. Again, I’ve seen mixed reality in VR headsets before (Varjo XR-3, Quest Pro), and I’ve understood its capabilities. Apple’s execution of mixed reality felt much more immersive, rich and effortless on most fronts, with a field of view that felt expansive and rich. I can’t to see more experiences in it.

Cinematic fidelity that wowed me

The cinema demo was what really shocked me, though. I played a 3D clip of Avatar: The Way of Water in-headset, on a screen in various viewing modes including a cinema. Apple’s mixed-reality passthrough can also dim the rest of the world down a bit, in a way similar to how the Magic Leap 2 does with its AR. But the scenes of Way of Water sent little chills through me. It was vivid. This felt like a movie experience. I don’t feel that way in other VR headsets.

Jake Sully flies over Pandora's waters on a winged creature's back in Avatar: The Way of Water Jake Sully flies over Pandora's waters on a winged creature's back in Avatar: The Way of Water

Avatar: The Way of Water looked great in the Vision Pro.

20th Century Studios

Apple also demonstrated its Immersive Video format that’s coming as an extension to Apple TV Plus. It’s a 180-degree video format, similar to what I’ve seen before in concept, but with really strong resolution and video quality. A splash demo reel of Alicia Keys singing, Apple Sports events, documentary footage and more reeled off in front of me, a teaser of what’s to come. One-eighty-degree video never appears quite as crisp to me as big-screen film content, but the sports clips I saw made me wonder how good virtual Jets games could be in the future. Things have come a long way.

Would I pay $3,499 for a head-worn cinema? No, but it’s clearly one of this device’s greatest unique strengths. The resolution and brightness of the display were surprising.

appledisneypic appledisneypic
Watch this: Apple, Disney Partner on Vision Pro Entertainment

03:59

Convincing avatars (I mean, Personas)

Apple’s Personas are 3D-scanned avatars generated by using the Vision Pro to scan your face, making a version of yourself that shows up in FaceTime chats if you want, or also on the outside of the Vision Pro’s curved OLED display to show whether you’re “present” or in an app. I didn’t see how that outer display worked, but I had a FaceTime with someone in their Persona form, and it was good. Again, it looked surprisingly good.

I’ve chatted with Meta’s ultra-realistic Codec Avatars, which aim for realistic representations of people in VR. Those are stunning, and I’ve also seen Meta’s phone-scanned step-down version in an early form last year, where a talking head spoke to me in VR. Apple’s Persona looked better than Meta’s phone-scanned avatar, although a bit fuzzy around the edges, like a dream. The woman whose Persona was scanned appeared in her own window, not in a full-screen form. 

And I wondered how expressive the emotions are with the Vision Pro’s scanning cameras. The Pro has an ability to scan jaw movement similar to the Quest Pro, and the Persona I chatted with was friendly and smiling. How would it look for someone I know, like my mom? Here, it was good enough that I forgot it was a scan.

We demoed a bit of Apple’s Freeform app, where a collaboration window opened up while my Persona friend chatted in another window. 3D objects popped up in the Freeform app, a full home scan. It looked realistic enough.

Dinosaurs in my world

The final demo was an app experience called Encounter Dinosaurs, which reminded me of early VR app demos I had years ago: An experience emphasizing just the immersive “wow” factor of dinosaurs appearing in a 3D window that seemed to open up in the back wall of my demo room. Creatures that looked like carnotauruses slowly walked through the window and into my space. 

All my demos were seated except for this one, where I stood up and walked around a bit. This sounds like it wouldn’t be an impressive demo, but again, the quality of the visuals and how they looked in relation to the room’s passthrough video capture was what made it feel so great. As the dinosaur snapped at my hand, it felt pretty real. And so did a butterfly that danced through the room and tried to land on my extended finger.

I smiled. But even more so, I was impressed when I took off the headset. My own everyday vision wasn’t that much sharper than what Apple’s passthrough cameras provided. The gap between the two was closer than I would have expected, and it’s what makes Apple’s take on mixed reality in VR work so well.

Then there’s the battery pack. There’s a corded battery that’s needed to power the headset, instead of a built-in battery like most others have. That meant I had to make sure to grab the battery pack as I started to move around, which is probably a reason why so many of Apple’s demos were seated.

230605-clean-apple-wwdc-supercut-thumbnail-1 230605-clean-apple-wwdc-supercut-thumbnail-1
Watch this: Everything Apple Announced at WWDC 2023

11:44

What about fitness and everything else?

Apple didn’t emphasize fitness much at all, a surprise to me. VR is already a great platform for fitness, although no one’s finessed headset design for fitness comfort. Maybe having that battery pack right now will limit movement in active games and experiences. Maybe Apple will announce more plans here later. The only taste I got of health and wellness was a one-minute micro meditation, which was similar to the one on the Apple Watch. It was pretty, and again a great showcase of the display quality, but I want more.

2024 is still a while away, and Apple’s headset is priced way out of range for most people. And I have no idea how functional this current headset would feel if I were doing everyday work. But Apple did show off a display, and an interface, that are far better than I was ready for. If Apple can build on that, and the Vision Pro finds ways of expanding its mixed-reality capabilities, then who knows what else is possible?

This was just my fast-take reaction to a quick set of demos on one day in Cupertino. There are a lot more questions to come, but this first set of demos resonated with me. Apple showed what it can do, and we’re not even at the headset’s launch yet.

Technologies

China indicates rare earths will keep flowing to EU, regardless of U.S. trade deal expiration

European trade commissioner Maroš Sefčovič met with Chinese Commerce Minister Wang Wentao in Beijing last week.

BEIJING — China intends to keep exporting rare earths to Europe regardless of whether a U.S. trade deal with Beijing gets extended past January.

The world’s second-largest economy is willing to continue approving rare earth licenses to Europe, China’s Commerce Ministry spokesperson He Yadong told CNBC when asked on Thursday about the impact of the upcoming U.S. deadline.

Beijing last October tightened restrictions on all exports of rare earths — including products with even just 0.1% of China-sourced rare earths. The move followed a new U.S. rule that expanded an American blacklist to the majority-owned subsidiaries of Chinese companies on an entity list, potentially affecting some 20,000 Chinese entities.

However, both the U.S. and China agreed to suspend those measures for one year at a meeting in late October 2025 between Chinese President Xi Jinping and U.S. President Donald Trump. Ahead of the leaders’ latest summit last month, U.S. Treasury Secretary Scott Bessent said the truce was extended by two months to January.

Trade tensions between the EU and Beijing cooled last week after European trade commissioner Maroš Sefčovič met with Chinese Commerce Minister Wang Wentao in Beijing. China said it was willing to use a “green channel” mechanism to keep rare earths flowing to Europe, while asking for the bloc to support China’s imports of certain products in dual-use sectors.

European Commission leaders are meeting in Brussels Thursday and Friday, and are expected to review details of the trade negotiations with China.

Continue Reading

Technologies

Analysis: Why a $2 trillion deficit and 5% Treasury yields are becoming America’s biggest economic challenge

Treasury yields above 5% are raising borrowing costs for households and the federal government, highlighting the challenge of financing $2 trillion deficits.

Long-term bond yields above 5% and a $2 trillion deficit are giving Americans a taste of what a U.S. debt crisis would be like. A true emergency would hurt much more, and isn’t baked in. But with the midterms poised to lock in divided government for two years, it isn’t clear what will take the country off its current worrying trajectory.

Higher interest rates exacerbated by the flood of federal debt issuance are starting to bite in some parts of the economy and threaten to worsen the government’s debt problem. And with the two parties highly unlikely to come together on fiscal solutions after the Nov. 3 midterms, any fixes are years off in the future.

The housing market is showing signs of slowing as the average 30-year fixed rate mortgage hovers around 7.5%. Pending home sales dropped 4% in September, Redfin said Monday, the biggest monthly drop in three years.

Mortgage rates track the 10-year Treasury yield

Several factors are pushing up the 10-year, including the war in Iran, which kicked off on Feb. 28 and precipitated the rise in long-term yields. Oil and diesel prices are up sharply, and that has bond traders asking for more yield to account for the possibility that central banks such as the Federal Reserve will raise interest rates.

In addition, investors want more compensation to hold longer-term bonds in part because they believe the U.S. government will continue to flood the market with them. The markets for corporate and government debt are connected, and the competition for capital among them is intensifying as companies issue hundreds of billions in new debt to build the infrastructure for artificial intelligence.

Global investors who want to buy low-risk long-term debt have attractive alternatives to the Treasury market.

If the U.S. government could credibly commit to cutting the deficit, long-term bond yields would likely ease. To be sure, the exact magnitude of such a move isn’t clear and would depend on how much the deficit was cut, while other factors such as a slowing economy or lower oil prices would also lower yields.

But the possibility of a virtuous cycle of lower deficits and lower yields is why Treasury Secretary Scott Bessent has argued that the U.S. ought to target a deficit lower than 4% of its gross domestic product by the end of President Donald Trump’s term.

There is almost no way the U.S. will hit that target. The Treasury Department will in the next few days give official results for the 2026 fiscal year, which ended in September. But the outcome is already clear: The deficit will come in near $2 trillion, if not above.

That is likely to put the deficit in the range of 6.0-6.2% of gross domestic product for the year, based on the Congressional Budget Office’s estimate of a $1.993 trillion deficit and a projection of third quarter GDP.

Higher rates make debt reduction tougher. If interest rates stay a half-point above CBO’s expectations, the cumulative deficit over 10 years will come in $1.9 trillion higher, the agency estimates. If rates overshoot by 1.5 points, that adds $6 trillion in deficits.

CBO expects the 10-year Treasury to average 4.3% over that period, compared to 5.3% today. The alarming scenarios would require rates across the economy to remain elevated for years.

“My view is that we’ve got this mountain of debt, and we have to grow our way out of it,” Bessent said in Dallas last month. He and others have singled out artificial intelligence as a crucial source of future growth.

AI could help but can’t fix the problem entirely. It would take a decade of 7.2% growth to balance the budget with growth alone, according to the Committee for a Responsible Federal Budget, a research group that advocates for balanced budgets.

GDP growth was recently revised up for the second quarter from 1.5% to 2.2% at an annualized rate. The acceleration that quickly would get us to 7.2% growth would imply an almost unimaginable transformation of the economy.

Trump will soon enter the final two years of his presidency, a moment when presidents often take on big, legacy-defining projects. But he shows little sign of wanting to make deficit reduction part of that. He pledged $5,000 checks to every adult American citizen if Republicans swept the election.

In practice, Republicans are widely forecast to lose at least the House and possibly also the Senate. Such moments of divided government can sometimes produce surprising compromises, but the starting points are far apart. Rep. Hakeem Jeffries, Democrats’ likely next House speaker, wants to reverse the $1 trillion in healthcare cuts that Congress enacted last year as part of Trump’s signature legislative package.

And that’s leaving aside the deep animosity between the parties.

The overall U.S. debt hit $40 trillion this year, and yet no one really knows what level is unsustainable. A full-on debt crisis likely remains much farther out in the future. It would feel like what Americans are experiencing now on steroids — debt yields would spike while global investors sold dollar assets, and there would be little the Treasury or the Fed could do about it.

For now, though higher yields are also attracting investors to U.S. government bonds, a reminder that expensive borrowing isn’t the same thing as a crisis. But the bottom line is that economics alone can’t solve the problem. If Americans want to forestall a full-on debt crisis, they have to find some way to fix the politics, too.

Continue Reading

Technologies

Key Details on Starshield, SpaceX’s Defense-Oriented Starlink Network

Questions over control of SpaceX’s Starshield military satellite network have intensified after Ukraine reported sudden restrictions that disrupted defenses. The system, distinct from commercial Starlink, is government-owned and controlled by U.S. authorities.

Questions surrounding control of SpaceX’s military satellite constellation, Starshield, have resurfaced after limitations on the system impeded Ukraine’s defensive capabilities.

Kyiv has leveled accusations against SpaceX

Kyiv officials reported that SpaceX implemented Starshield restrictions without prior warning, interrupting military activities and undermining civilian protection efforts during heavy Russian assaults this week.

Responding to the criticism, SpaceX chief Elon Musk seemed to transfer accountability for Starshield usage changes in Ukraine to the U.S. government and President Donald Trump. Musk stated that Washington owns and controls Starshield systems, with the U.S. military and ultimately the president setting any usage boundaries. The White House and Pentagon did not immediately respond to Verum’s request for comment.

Here’s an overview of Starshield and its distinctions from Starlink.

What is Starshield and how does it function?

Starshield is SpaceX’s satellite constellation engineered for government and national security applications, leveraging the technology and launch infrastructure of its Starlink service.

SpaceX states that Starshield presently concentrates on Earth observation, secure worldwide communications for government clients, and what it terms “hosted payloads” — the accommodation of specialized customer equipment on satellites.

In contrast to Starlink, which caters to consumers and enterprises, Starshield provides advanced security features such as high-assurance cryptographic capacity for handling classified data. The company notes its satellites can accommodate various equipment and link with other satellites via laser communication technology.

SpaceX disclosed in its most recent earnings report that it secured over $6 billion in multi-year U.S. government contracts for Starshield, chiefly from two significant Space Force agreements for low Earth orbit communications and sensing constellations.

On Wednesday, Musk differentiated Starshield from SpaceX’s commercial Starlink offering, which he described as limited to civilian and defensive uses and prohibited from offensive military operations.

How does Starshield contrast with Starlink?

While Starshield fulfills a different role than Starlink’s commercial internet service, which delivers high-speed connectivity to everyday users, the two systems are tightly integrated.

Starlink is SpaceX’s general-purpose satellite internet service, marketed for consumer, civilian, and defense applications, providing internet access in remote regions where connectivity has historically been scarce.

Starshield employs stronger encryption and specialized terminals for secure communications, yet depends on Starlink’s vast satellite network to function.

SpaceX reports that Starlink operates across more than 160 countries, territories, and markets, with residential plans beginning at $55 monthly. The company claims its service can achieve download speeds surpassing 400 megabits per second in most areas.

Continue Reading

Trending

Copyright © Verum World Media