Connect with us

Technologies

Apple Vision Pro Hands-On: Far Better Than I Was Ready For

I experienced incredible fidelity, surprising video quality and a really smooth interface. Apple’s first mixed-reality headset nails those, but lots of questions remain.

I was in a movie theater last December watching Avatar: The Way of Water in 3D, and I said to myself: «Wow, this is an immersive film I’d love to watch in next-gen VR.» That’s exactly what I experienced in Apple’s Vision Pro headset, and yeah, it’s amazing.

On Monday, I tried out the Vision Pro in a series of carefully picked demos during WWDC at Apple’s Cupertino, California, headquarters. I’ve been using cutting-edge VR devices for years, and I found all sorts of augmented reality memories bubbling up in my brain. Apple’s compact — but still not small —headset reminds me of an Apple-designed Meta Quest Pro. The fit of the back strap was comfy yet stretchy, with a dial to adjust the rear fit and a top strap for stability. The headset’s sleek design, and even its glowing front faceplate, also gave me an instant Ready Player One vibe. 

vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png vision-pro-apple-walks-through-mixed-reality-headset-design-mp4-00-00-37-04-still001.png
Watch this: Apple Vision Pro: I Tried Apple’s AR/VR Headset

05:35

I couldn’t wear my glasses during the demo, though, and neither will you. Apple’s headset does not support glasses, instead relying on Zeiss custom inserts to correct wearers’ vision. Apple did manage, through a setup process, to easily find lenses that fit my vision well enough so that everything seemed crystal clear, which is not an easy task. Also, we adjusted the fit and tuned spatial audio for my head using an iPhone, a system that will be finessed when the headset is released in 2024.

From there, I did my demos seated, mostly, and found myself surprised from the start. The passthrough video camera quality of this headset is good —really, really good. Not as good as my own vision, but good enough that I could see the room well, see people in it with me, see my watch notifications easily on my wrist. The only headset that’s done this previously was the extremely impressive but PC-connected Varjo XR-3, and Apple’s display and cameras feel even better.

Apple’s floating grid of apps appears when I press the top digital crown, which autocenters the home screen to wherever I’m looking. I set up eye tracking, which worked like on many other VR headsets I’ve used: I looked at glowing dots as musical notes played, and got a chime when it all worked.

An app menu in Apple's VisionOS. An app menu in Apple's VisionOS.

A list of apps as they would appear inside of the Apple Vision Pro headset.

Apple/Screenshot by CNET

From there, the interface was surprisingly fluid. Looking at icons or interface options slightly enlarges them, or changes how bold they appear. Tapping with my fingers while looking at something opens an app. 

I’ve used tons of hand-tracking technology on headsets like the HoloLens 2 and the Meta Quest 2 and Pro, and usually there’s a lot of hand motion required. Here, I could be really lazy. I pinched to open icons even while my hand was resting in my lap, and it worked. 

Scrolling involves pinching and pulling with my fingers; again, pretty easy to do. I resized windows by moving my hand to throw a window across the room or pin it closer to me. I opened multiple apps at once, including Safari, Messages and Photos. It was easy enough to scroll around, although sometimes my eye tracking needed a bit of extra concentration to pull off.

Apple’s headset uses eye tracking constantly in its interface, something Meta’s Quest Pro and even the PlayStation VR 2 don’t do. That might be part of the reason for the external battery pack. The emphasis on eye tracking as a major part of the interface felt transformative, in a way I expected might be the case for VR and AR years ago. What I don’t know is how it will feel in longer sessions.

I don’t know how the Vision Pro will work with keyboards and trackpads, since I didn’t get to demo the headset that way. It works with Apple’s Magic Keyboard and Magic Trackpad, and Macs, but not with iPhone and iPad or Watch touchscreens —not now, at least.

Dialing in reality

I scrolled through some photos in Apple’s preset photo album, plus a few 3D photos and video clips shot with the Vision Pro’s 3D camera. All the images looked really crisp, and a panoramic photo that spread around me looked almost like it was a window on a landscape that extended just beyond the room I was in. 

Apple has volumetric 3D landscapes on the Vision Pro that are immersive backgrounds like 3D wallpaper, but looking at one really shows off how nice that Micro OLED display looks. A lake looked like it was rolling up to a rocky shore that ended right where the real coffee table was in front of me. 

man using keyboard to work using apple vision pro headset man using keyboard to work using apple vision pro headset

Raising my hands to my face, I saw how the headset separates my hands from VR, a trick that’s already in Apple’s ARKit. It’s a little rough around the edges but good enough. Similarly, there’s a wild new trick where anyone else in the room can ghost into view if you look at them, a fuzzy halo with their real passthrough video image slowly materializing. It’s meant to help create meaningful contact with people while wearing the headset. I wondered how you could turn that off or tune it to be less present, but it’s a very new idea in mixed reality.

Apple’s digital crown, a small dial borrowed from the Apple Watch, handles reality blend. I could turn the dial to slowly extend the 3D panorama until it surrounded me everywhere, or dial it back so it just emerged a little bit like a 3D window. 

Mixed reality in Apple’s headset looks so casually impressive that I almost didn’t appreciate how great it was. Again, I’ve seen mixed reality in VR headsets before (Varjo XR-3, Quest Pro), and I’ve understood its capabilities. Apple’s execution of mixed reality felt much more immersive, rich and effortless on most fronts, with a field of view that felt expansive and rich. I can’t to see more experiences in it.

Cinematic fidelity that wowed me

The cinema demo was what really shocked me, though. I played a 3D clip of Avatar: The Way of Water in-headset, on a screen in various viewing modes including a cinema. Apple’s mixed-reality passthrough can also dim the rest of the world down a bit, in a way similar to how the Magic Leap 2 does with its AR. But the scenes of Way of Water sent little chills through me. It was vivid. This felt like a movie experience. I don’t feel that way in other VR headsets.

Jake Sully flies over Pandora's waters on a winged creature's back in Avatar: The Way of Water Jake Sully flies over Pandora's waters on a winged creature's back in Avatar: The Way of Water

Avatar: The Way of Water looked great in the Vision Pro.

20th Century Studios

Apple also demonstrated its Immersive Video format that’s coming as an extension to Apple TV Plus. It’s a 180-degree video format, similar to what I’ve seen before in concept, but with really strong resolution and video quality. A splash demo reel of Alicia Keys singing, Apple Sports events, documentary footage and more reeled off in front of me, a teaser of what’s to come. One-eighty-degree video never appears quite as crisp to me as big-screen film content, but the sports clips I saw made me wonder how good virtual Jets games could be in the future. Things have come a long way.

Would I pay $3,499 for a head-worn cinema? No, but it’s clearly one of this device’s greatest unique strengths. The resolution and brightness of the display were surprising.

appledisneypic appledisneypic
Watch this: Apple, Disney Partner on Vision Pro Entertainment

03:59

Convincing avatars (I mean, Personas)

Apple’s Personas are 3D-scanned avatars generated by using the Vision Pro to scan your face, making a version of yourself that shows up in FaceTime chats if you want, or also on the outside of the Vision Pro’s curved OLED display to show whether you’re «present» or in an app. I didn’t see how that outer display worked, but I had a FaceTime with someone in their Persona form, and it was good. Again, it looked surprisingly good.

I’ve chatted with Meta’s ultra-realistic Codec Avatars, which aim for realistic representations of people in VR. Those are stunning, and I’ve also seen Meta’s phone-scanned step-down version in an early form last year, where a talking head spoke to me in VR. Apple’s Persona looked better than Meta’s phone-scanned avatar, although a bit fuzzy around the edges, like a dream. The woman whose Persona was scanned appeared in her own window, not in a full-screen form. 

And I wondered how expressive the emotions are with the Vision Pro’s scanning cameras. The Pro has an ability to scan jaw movement similar to the Quest Pro, and the Persona I chatted with was friendly and smiling. How would it look for someone I know, like my mom? Here, it was good enough that I forgot it was a scan.

We demoed a bit of Apple’s Freeform app, where a collaboration window opened up while my Persona friend chatted in another window. 3D objects popped up in the Freeform app, a full home scan. It looked realistic enough.

Dinosaurs in my world

The final demo was an app experience called Encounter Dinosaurs, which reminded me of early VR app demos I had years ago: An experience emphasizing just the immersive «wow» factor of dinosaurs appearing in a 3D window that seemed to open up in the back wall of my demo room. Creatures that looked like carnotauruses slowly walked through the window and into my space. 

All my demos were seated except for this one, where I stood up and walked around a bit. This sounds like it wouldn’t be an impressive demo, but again, the quality of the visuals and how they looked in relation to the room’s passthrough video capture was what made it feel so great. As the dinosaur snapped at my hand, it felt pretty real. And so did a butterfly that danced through the room and tried to land on my extended finger.

I smiled. But even more so, I was impressed when I took off the headset. My own everyday vision wasn’t that much sharper than what Apple’s passthrough cameras provided. The gap between the two was closer than I would have expected, and it’s what makes Apple’s take on mixed reality in VR work so well.

Then there’s the battery pack. There’s a corded battery that’s needed to power the headset, instead of a built-in battery like most others have. That meant I had to make sure to grab the battery pack as I started to move around, which is probably a reason why so many of Apple’s demos were seated.

230605-clean-apple-wwdc-supercut-thumbnail-1 230605-clean-apple-wwdc-supercut-thumbnail-1
Watch this: Everything Apple Announced at WWDC 2023

11:44

What about fitness and everything else?

Apple didn’t emphasize fitness much at all, a surprise to me. VR is already a great platform for fitness, although no one’s finessed headset design for fitness comfort. Maybe having that battery pack right now will limit movement in active games and experiences. Maybe Apple will announce more plans here later. The only taste I got of health and wellness was a one-minute micro meditation, which was similar to the one on the Apple Watch. It was pretty, and again a great showcase of the display quality, but I want more.

2024 is still a while away, and Apple’s headset is priced way out of range for most people. And I have no idea how functional this current headset would feel if I were doing everyday work. But Apple did show off a display, and an interface, that are far better than I was ready for. If Apple can build on that, and the Vision Pro finds ways of expanding its mixed-reality capabilities, then who knows what else is possible?

This was just my fast-take reaction to a quick set of demos on one day in Cupertino. There are a lot more questions to come, but this first set of demos resonated with me. Apple showed what it can do, and we’re not even at the headset’s launch yet.

Technologies

Anno 117 Pax Romana Preview: A Beautiful Simulation of a Prosperous Time

Diplomats and traders rejoice. The year 117 is a perfect setting for the Anno series.

Over three decades, the Anno series has plunged gamers into deep real-time strategy experiences set within some of the most massive empires that humans have ever built. From the Renaissance to the Industrial Revolution, Anno tasks players with balancing ravenous economic growth with conflicts of ideological revolution — and coming out the other side with a strong, unified state.

The next game in the series, Anno 117: Pax Romana, has the earliest historical setting for the Anno series to date, and it’s an incredibly ambitious shift (nearly as much as the brief stint in futuristic settings with Anno 2070 and Anno 2205). As the dates suggest, Anno 117 takes place during a time of immense economic and cultural prosperity in antiquity — and I got an early peek at how that looks during a three-hour hands-on virtual preview session moderated by an Ubisoft employee.

While Anno 117: Pax Romana is a game where you’ll still be focusing on your economy and fostering positive relations first and foremost, you’ll also need to consider building fortifications and training units for land and sea combat.

As the game is centered on growing your own Roman empire, you’ll have to choose which end to colonize first, either beginning in Latium (in modern-day western Italy, around Rome) as a Roman governor or expanding Celtic influence by starting in Albion (in modern-day England). My hands-on preview was limited to Roman gameplay, but I was able to see how much depth the Celts add to the game. Starting in Albion doesn’t just change the map geography and resource nodes you can build around, it changes the research trees, religions and construction projects you’re able to access as well.

Many contemporary 4X strategy games (it stands for explore, expand, exploit and exterminate) such as Sid Meier’s Civilization 7 and Age of Mythology: Retold focus heavily on outmaneuvering and destroying your opponents. In Anno 117, there isn’t really the same type of «win condition» — and there’s far less extermination to revel in overall.

The interwoven construction systems of Anno 117 are easy to pick up but difficult to master, especially if you want your empire to span multiple islands across the map. Here’s what I picked up about the game during my three-hour preview.

When building a civilization, the devil is in the details

If you’re choosing to set a game in the golden age of Roman civilization, it definitely makes sense to focus on graphical fidelity — I’m sitting down here to engage with the beauty and culture of Pax Romana.

Anno 117 doesn’t disappoint in this regard. Toward the tail end of my hands-on preview, I frequently found myself straying away from my self-imposed objectives to simply watch my citizens barter in the marketplace or work away on the wheat or hemp farms that stretched across the countryside.

Each dwelling you build adds three new citizens to your island, and these nonplayable characters are fully simulated as they go about their day-to-day business.

I watched the plebeians master their crafts, making silks and baking bread before they retired to cultural centers to find an education. The lower class libertini mined ore, chopped wood and delivered goods on handcarts, creating a constant stream of foot traffic that was mesmerizing to keep an eye on.

The complexity of these real-time interactions is a real treat. If too many workers gather at a warehouse with goods and raw materials, the roadways jam up and productivity drastically drops. It felt incredibly natural to manage these blockages and make necessary adjustments because I was already so involved with the little lives carrying on in the game.

Once you build something you feel truly proud of, Anno 117 has features that let you toggle the heads-up display off — I used this photo mode to capture some of my favorite pictures for this section of my preview. The images can’t capture the simple joy of watching fields of golden wheat swaying in the wind, but I think they convey the splendor of a budding city-state in Latium.

You might need an urban planning degree to run a well-oiled machine

If I could go back in time and restart my Anno 117 preview play session, I’d choose to take a beat before beginning construction on my starting island.

That’s no joke — every resource node, production center and citizen dwelling will affect how future supply chains are built, and that’s before factoring in the increasingly complex web of roads you’ll have to build to connect everything to the docks.

I shrugged and placed my first houses and farms randomly in the middle of the map, and it started causing problems for me hours later when I needed to build out unhygienic pigsties and hazardous kilns to broaden my civilization’s economic prospects.

There’s almost an overwhelming number of variables to juggle. Resources can only be extracted from certain nodes (and some fisheries and farms can only be built where the soil or water is suitably fertile for them), warehouses need to be located close enough for storage and production facilities will need speedy access to requisite materials.

More complex goods require multiple resources to make, which means your supply chains will become even more complicated as ore, grain and animal products move further and further around your budding city.

As settlements become cities, problems emerge. Certain structures can spread disease and others are fire hazards, and you’ll need to invest in Pax Romana’s version of hospitals and firemen to mitigate these risks. I didn’t have to worry about invading forces in the demo — my Pax Romana was a true time of peace — but you’ll have to secure your borders in the full release, ensuring that there is enough military manpower spread around that your citizens are safe. It’s been some time since land combat was featured in an Anno game, but you can train warriors and scouts that patrol your land for different quest objectives.

The speed of your city’s growth and expansion is largely dependent on the caliber of citizens you’re drawing to your island: In order to upgrade your citizens, you must cater to their basic needs and their luxury wants by building them into the city-state’s supply chain.

This can be confusing to a new player — I was left momentarily scratching my head about being limited to construction of logging camps, wheat farms and basic food and clothing production — but the real construction possibilities open up once you begin diversifying your population with more worker types. I unlocked the plebeians in the latter half of my first hour with Anno 117, and that’s when the game truly picked up and more construction options became available.

Even so, I’d caution against rushing the citizen class upgrades. Expanding too quickly is a huge strain on your purse, and I found that I needed to spend a lot of denarii in order to establish a decent income.

This is one of the cases where slow and steady improvements to your supply lines are extremely important. I quickly learned the lesson that private equity seemingly hasn’t: Don’t sacrifice long-term growth on the altar of short-term profits. That’s a good way to get hosed down with a net negative denarii drain, which will slow your expansion indefinitely.

If you’re willing to take the time to do some very basic planning before clearing out trees and establishing your first builds, I expect players will find Anno 117 to be a very rewarding (if occasionally confusing) city builder spanning a rich territorial tapestry of different island factions.

Hidden at the periphery: Trade routes, disputes and random events

During my three-hour play session, I was largely relegated to a single island, building out the basic necessities and cultural landmarks that serve to kickstart a burgeoning Roman province. Even still, I was able to get a glimpse at some of the game’s deeper systems — and there’s a lot going on in the wider world while the player is getting themselves situated.

There are many other nonplayable characters governing their own states on neighboring islands, and I would occasionally get notifications informing me of their achievements in research, development and trade.

These pop-ups created a sense of urgency — my civilization was not being built within a vacuum, and I couldn’t be sure if these other peoples had a tendency to build mutually beneficial relationships or if they stood only to conquer their nearby foes. I mostly enjoy building trade routes and forging alliances with others, but I would be lying if I said that these infrequent updates didn’t have me contemplating an investment in a bigger military presence.

I imagine that starting with the Romans in Latium or the Celts in Albion won’t just affect the nodes you can unlock in your research tree, but will change the way different neighbors interact with you as you make contact with them throughout the wider world.

Not every interaction with outsiders is a promise to paint the streets or oceans red — and outside of trade, there are other ways that NPC factions help you build a better future.

Provinces that adopt the same faith as you cement the belief in your gods, and both societies will reap greater buffs as the religion spreads among a larger population. These boons can increase research speed, military might or economic production. A rising tide raises all ships, and spreading religious fervor benefits all governors who worship the same gods.

Players will exert influence on the wider world, but it will also exert an influence on their own city-state: The society they’ll build is only one piece of a much grander, ever-shifting puzzle.

On a more granular level, a player’s civilization will undergo random events and disputes that keep it in a state of perpetual motion. Their people are never at a standstill (unless one uses their omnipotent powers to literally pause time) and as such, they’ll have trade disagreements, spread rumors and even riot.

Some of these events are simple decisions: In a moment of economic turmoil, I took a bribe from a wealthy businessman, but ended up enraging workers throughout the city; another time, I chose a personal advisor who increased my passive income instead of one who would optimize the storage of my warehouses.

Other events start up more involved questlines — when citizens live in fear of a nearby shipwreck that is said to be haunted, I’d have to train up a scouting party and send them into the depths to report on what was truly happening. These secondary objectives make your territories feel alive and engage the player outside of the usual city-building activities.

There’s a complex world hidden behind the curtain of Anno 117, but the game is approachable for new real-time strategy players, continuing the series’ usual throughline of placing an emphasis on solving conflict through economic and diplomatic means.

Combat is certainly present, but I was able to completely avoid it during my preview session, leading me to wonder how much fighting there will truly be for the more military-minded players. Either way, Anno 117: Pax Romana sold me on its premise — and I wanted to continue building my empire during this historically unprecedented time of peace.

Anno 117: Pax Romana is set to be released in 2025, but we don’t have an exact date as of yet. The game will be available on PC, PS5 and Xbox Series X and S.

Continue Reading

Technologies

Google I/O 2025: How to Watch Google’s Biggest Event (and What to Expect)

Google’s biggest event of the year will almost certainly be about all the ways AI will help you get stuff done.

Google’s main I/O 2025 keynote takes place on May 20, with I/O continuing over May 21 for developers to get hands-on with Google’s latest products. At its keynote, we expect Big G to talk about its various innovations across its constantly expanding suite of products and tools — no doubt with a huge focus on AI throughout. If we collectively cross our fingers, promise to be good and eat all our vegetables, then we may even be treated to a sneak peek at upcoming hardware. 

Read more: Android 16: Everything Google Announced at the Android Show

Google also hosted a totally separate event that focused solely on Android. The Android Show: I/O Edition saw the wrappers come off Android 16, with insights into the new Material 3 Expressive interface, updates to security and a focus on Gemini and how it’ll work on a variety of other devices. 

By breaking out Android news into its own virtual event, Google frees itself to spend more time during the I/O keynote to talk about Gemini, Deep Mind, Android XR and Project Astra. It’s going to be a jam-packed event, so here’s how you can watch I/O 2025 as it happens and what you can look forward to.

Google I/O: Where to watch

Google I/O proper kicks off with a keynote taking place on May 20, 10 a.m. PDT (1 p.m. EDT, 6 p.m. BST). It’ll be available to stream online on Google’s own YouTube channel. There’s no live link on the I/O website yet, though you can use the handy links to add the event to your calendar of choice and register your details if you want more info from Google. Which maybe you do. 

What to expect from Google I/O 2025

Not much chat about Android 16: As Google gave Android 16 its own outing already, it’s likely that it won’t be mentioned all that much during I/O. In fact at last year’s event, Android was barely mentioned, while uses of the term «AI» went well over a hundred. 

Android XR: Google didn’t talk much about Android XR during the Android show, focusing instead on the purely phone-based updates to the platform. We expected to hear more about the company’s latest foray into mixed-reality headsets in partnership with Samsung and its Project Moohan headset, so it’s possible that this is being saved for I/O proper. 

Gemini: With Android being spun out into its own separate event, Google is evidently clearing the way for I/O to focus on everything else the company does. AI will continue to dominate the conversation at I/O, just as it did last year (though hopefully Google can make it more understandable) with updates to many of its AI platforms expected to be announced. 

Gemini is expected to receive a variety of update announcements, including more information on its latest 2.5 Pro update which boasts various improvements to its reasoning abilities, and in particular to its helpfulness for coding applications. Expect lots of mentions of Google’s other AI-based products, too, including DeepMind, LearnLM and Project Astra. Let’s just hope Google has figured out how to make this information make any kind of sense.

Beyond AI, Google may talk about updates to its other products including GMail, Chrome and the Play Store, although whether these updates are big enough to be discussed during the keynote rather than as part of the developer-focused sessions following I/O’s opening remains to be seen.

Continue Reading

Technologies

Want to Speak to Dophins? Researchers Won $100,000 AI Prize Studying Their Whistling

The scientists studied a bottlenose dolphin community in Sarasota, Florida, uncovering evidence of language-like communications.

If any dolphins are reading this: hello!

A team of scientists studying a community of Florida dolphins has been awarded the first $100,000 Coller Dolittle Challenge prize, set up to award research in interspecies communication algorithms.

The US-based team, led by Laela Sayigh of the Woods Hole Oceanographic Institution, found that a type of whistle that dolphins employ is used as an alarm. Another whistle they studied is used by dolphins to respond to unexpected or unfamiliar situations. The team used non-invasive hydrophones to perform the research, which provides evidence that dolphins may be using whistles like words, shared with multiple members of their communities.

Capturing the sounds is just the beginning. Researchers will use AI to continue deciphering the whistles to try to find more patterns. 

«The main thing stopping us cracking the code of animal communication is a lack of data. Think of the 1 trillion words needed to train a large language model like ChatGPT. We don’t have anything like this for other animals,» said Jonathan Birch, a professor at the London School of Economics and Politics and one of the judges for the prize.

«That’s why we need programs like the Sarasota Dolphin Research Program, which has built up an extraordinary library of dolphin whistles over 40 years. The cumulative result of all that work is that Laela Sayigh and her team can now use deep learning to analyse the whistles and perhaps, one day, crack the code,» he said.

The award was part of a ceremony honoring the work of four teams from across the world. In addition to the dolphin project, researchers studied ways in which nightingales, marmoset monkeys and cuttlefish communicate.

The challenge is a collaboration between the Jeremy Coller Foundation and Tel Aviv University. Submissions for next year open up in August. 

Continue Reading

Trending

Copyright © Verum World Media