Technologies

Apple’s Vision Pro Will Display Your Eyes to Those Around You

The EyeSight feature on Apple’s mixed-reality headset will show your eyes while you’re just scrolling apps to indicate you can see those nearby.

As it unveiled the Vision Pro, Apple’s new mixed reality headset, Apple revealed the AR/VR device will display your actual eyes to those around you while you’re wearing the headset, using a feature it’s calling EyeSight.

«Your eyes are a critical indicator of connection and emotion, so Vision Pro displays your eyes when someone is nearby,» Apple said during its annual Worldwide Developers Conference on Monday at Apple HQ in Cupertino, California, calling the feature «incredible.»

Apple said during the WWDC keynote that the feature will help provide «important cues to others about what you’re focused on.»

More from WWDC 2023

If you’re just scrolling your Vision Pro apps, your eyes will show up on the headset. But if you’re «fully immersed in an experience,» your eyes won’t be shown — which signals those around you that you cannot see them at that moment, according to Apple.

«We also thought hard about how others can interact with you while wearing vision pro eyesight utilizes a unique curved OLED panel with a lenticular lens to project the correct perspective of your eyes to each person looking at you,» Apple said. «The result is a 3D display that makes the device look transparent.»

Your eyes are an important feature for Vision Pro. The tech giant said that unlike all of its previous major platforms, which used physical inputs such as a mouse, a click wheel or multitouch, the mixed-reality headset will rely «solely on your eyes, hands and voice.»

«With Vision Pro we set the ambitious goal to design an incredibly intuitive input model for spatial computing,» Apple said. «It’s just you and your content. It’s remarkable and it feels like magic.»

Here’s how to watch Apple’s WWDC keynote.

Technologies

AT&T Says It’s Pumping $250 Billion Into New Infrastructure Improvements

Technologies

Apple’s New Smart Home Display Delayed Until Fall Over Siri Issues

It has been nearly a year and a half since the company announced the AI-powered product.

Your home could get smarter with Apple’s Siri, but it will have to wait a few more months. Bloomberg reported the iPad-shaped AI home hub won’t be ready until September, several months after the company was hoping to launch it this spring. Apple engineers first need to complete work on a new and improved Siri assistant for the home device, code-named J490, according to Bloomberg.

Apple was hoping to release J490 this month, along with a slew of other new devices, including the iPhone 17e, MacBook Neo, MacBook Air M5, new Pro models, and iPad Air M4. Apple first teased the smart home display in November 2024.

A representative for Apple did not immediately respond to a request for comment.

Siri is Apple’s virtual assistant that uses voice recognition and AI to fulfill a variety of tasks and commands, along with intriguing uses. You might use Siri to find your iPhone — «Hey Siri, where are you?» — or to hear the weather forecast — «Siri, what will the weather be today?» Siri is available on iPhones, MacBooks and iPads. It was launched in 2011 as a feature of the iPhone 4S.

As CNET reported last month, Apple engineers have struggled to push the upgraded Siri assistant out the door. It isn’t fast enough, gets confused by complex commands and doesn’t interact well with other Apple AI models. The company is also wrestling with how much personal data to access to inform the AI, and the new Siri is not yet able to complete in-app tasks, such as finding a photo and posting it to socials, all with one command.

It has been nearly two years since Apple announced that it would give Siri a major upgrade. In the meantime, competitors like Alexa Plus and Gemini for Home have entered the marketplace.

Tech tester Jon Rettinger, whose YouTube channel has 1.66 million subscribers, says the repeated delays in upgrading Siri can «erode» confidence in Apple’s ability to keep up in the AI race.

«Apple as a whole is still one of the strongest companies on the planet. But their AI play is clearly the weakest link in an otherwise very strong chain,» Rettinger told CNET.

Rettinger said he has had issues getting Siri to complete basic commands, such as setting two alarms at the same time, and that it’s a bit of «a mess» right now.

«Having said that, the iPhone has such massive market penetration that I’m not sure it will actually matter in the end. Which is kind of wild when you think about it,» Rettinger said.

Facial recognition for residents

The hardware for the forthcoming smart home display has already been finished. It resembles an iPad and can be either attached to a wall or rest on a half-domed-shaped base, the Bloomberg report said.

The device will be equipped with facial recognition, so when residents walk up to it, they will be shown personalized data such as music preferences, news headlines, appointments, reminders, tasks and so on.

The screen interface will include a bunch of circular app icons, similar to the display on an Apple Watch. The Bloomberg report said the smart home display will be the first of several home devices by Apple. Future products include a tabletop robotic limb with a 9-inch screen, a smart security camera and a Face ID-enabled smart doorbell.