Technologies

Apple iPhone Spatial Video Arrives in Beta and Looks Amazing on Vision Pro

I tried the new iPhone 15 Pro camera feature on Apple’s upcoming AR-VR headset. The 3D is undeniably vivid.

I’m looking at a plate of sushi hovering in front of me in 3D. The chef finishes off toppings on yellowtail rolls and tuna, talking to me as she works. It looks vivid. It looks real. The amazing part is that I just shot this video myself, moments earlier, on an iPhone 15 Pro. And now it’s a VR experience I’m watching in beautiful 3D on Apple’s Vision Pro headset.

I swipe with my fingers and watch other ghostly videos Apple provided. Families in a home, walking through grass. Cuddling together. All in lifelike 3D. I feel like I’m peeking in on their lives, which is weird and intimate. But the vividness is undeniable.

I’m experiencing Apple’s new Spatial Video iPhone camera feature, now available in Apple’s new iOS 17.2 public beta, with the final version rolling out in 17.2 later this year. It allows you to record 3D videos, but to use it you’ll need Apple’s best phone, the $1,000 iPhone 15 Pro. And to watch the videos in 3D you’ll need the $3,500 Vision Pro headset, which launches early next year.

The videos look great and the 3D is compellingly realistic. They’re also easy to record, and can save as videos that will play back in 2D in a normal video format. But ultimately this feature is made for a 2024 product that, at $3,500, it’s safe to say most people won’t buy anytime soon. Still, the experience is impressive.

Vision Pro impressed me once again

I first used the Vision Pro at Apple’s WWDC conference in June, and once again I’m reminded of its extraordinary display capabilities. Photos and video look fantastic on Apple’s headset. I’d even venture to say the Vision Pro beats any display I have anywhere in my home right now. Yes, I’d want to look at videos and photos — 3D and otherwise — if I had a Vision Pro.

My second dive into the Vision Pro, complete with fitted prescription lenses that matched my needs, reminds me how much smaller the headset was than I remembered. And also, how effortless the interface is.

Setting up eye tracking was a rapid process; I looked at dots around a circle and tapped them. I also tried a new set of zoom gestures, pinching my fingers and stretching them to expand photos. The gesture works with eye tracking, so wherever I looked, the image expanded. It felt like telepathy. I got to look through a few test photos in the Photos app, and play back photos in Memories. After having used a Quest 3 recently, Apple’s passthrough cameras and display resolution are on another planet.

Panoramic photos were a surprise. They opened up and wrapped around me, felt like windows into other places — almost 3D, in fact. And spatial videos look nice, too. Their 3D, almost ghostly playback quality feels like it’s aiming for an immersive memory more than a straight-up video playback. But I found some limits even in my brief demo of the experience.

Unfortunately, there aren’t any captures of what I saw or recorded here: the photos are all ones Apple provided, so you’ll have to just follow along and read about my experience.

02-iphone-15-pro-cameras-for-spatial-video

Spatial videos on iPhone 15 Pro: How they work

Spatial videos need to be recorded by holding the phone horizontally. The iPhone 15 Pro uses its main and ultrawide cameras side-by-side in landscape mode to create the 3D video. It records two 1080p, 30fps videos at once, resolving the lens and distance differences with computational photography. The file is saved in HEVC format, similar to other Apple video files, with a storage size of about 130MB a minute. That’s not too bad, likely because the files are limited to that relatively low 1080p and 30fps resolution and framerate.

Spatial video clips can be shared via Messages or AirDrop, but there could be cases where files are compressed down in other apps, losing the 3D data. Still, the video clips should be usable anywhere as an everyday video file, which is great news for anyone who wondered (myself included) whether you’d have to choose a “special” 3D video format.

You do have to toggle Spatial Video mode on, either inside Apple’s Camera app settings or with a Vision Pro-mask-shaped toggle in the Camera app itself. That limits your video resolution and frame rate, and also means you have to shoot in landscape. Sorry, no 3D vertical videos.

The camera app makes recommendations on turning the camera sideways, and staying a certain distance from a subject. I was told to stay within 3 to 8 feet of what I was shooting for a good spatial video, but when I shot my test recording of someone making sushi at a table I got up closer and it looked perfectly fine. I also recorded in a well-lit room, but apparently the spatial video recording mode prevents adjustments on brightness and contrast, which means low-light recording may end up grainier than normal videos.

03-spatial-video-capture-on-iphone-15-pro

How will spatial video evolve or be edited?

There’s no API for Apple’s 3D HEVC video format, which means the files are not designed so that third-party apps can recognize them yet. But it’s possible app developers will figure out some sort of a solution. Also, it’s disappointing that there’s no other way to view the videos in 3D than on a Vision Pro.

The stereo 3D recording theoretically sounds like a process that could be adapted for other VR headsets like the $500 Meta Quest 3. It’s straightforward stereo video, and doesn’t use lidar or depth sensing for any sort of full-movement spatial capture. Unfortunately that’s not currently in Apple’s plans.

There’s no recording limit on the videos, so you could theoretically make a spatial video 3D feature-length film. But the clips will only be able to be trimmed, either in the iPhone or Vision Pro. Final Cut Pro, Apple’s video editing software, will get Spatial Video editing support, but not until sometime next year. Meanwhile if you do end up trying to edit these video files in a Mac or iOS video editor, they’ll end up being converted over into 2D-only files.

It’s also a tiny bit disappointing that the videos can’t be recorded in 4K resolution. Apple’s Vision Pro headset has astounding quality and resolution, which became clear once again as I looked at iPhone photos in the headset and zoomed in on them, or viewed panoramic photos in a wraparound mode that made it feel like I was in a vivid immersive recreation of a location, similar to a 360-degree photo. The spatial videos look really nice, but I felt the desire to see them in more fluid 60fps, 4K or both. Maybe someday.

Memories for a 3D future

Apple often seems like it’s trying to become not just a lifestyle, but a memory company. Automated photo collections are already called “Memories.” And that’s how 3D spatial videos feel on Vision Pro: hazily bordered, like digital recollections in some Minority Report or Bladerunner future. It reminded me, too, of some of the immersive 3D realism I had using Google’s real-time 3D light field conversations in Project Starline, but in this case I was just watching videos.

Apple’s choice to frame the spatial videos in a fuzzy sort of frame makes it look more like the videos are almost holographically being cast into the room, and the edges sort of dissolve a bit. But I’d love to see a way for the videos to have a standard frame around them, too.

Apple’s spatial video format shows up in a new category of its own on the Photos app, and won’t show up in Memories yet. Maybe this new spatial video tab in Photos becomes the go-to repository for new 3D experiences. Right now, Apple isn’t allowing 3D spatial photos on the iPhone 15 Pro, just videos, although the Vision Pro can capture photos itself. But Apple’s clearly aiming for everyone to hopefully start recording in the format before the headset arrives, building a library of capable videos.

That means you’ll have to remember to toggle spatial video on, and care to use it. Future Vision Pro owners will have that feature toggled on by default on the iPhone 15 Pro, but that’s a tiny portion of iPhone owners. I’ll be turning it on, because I want to see what my videos will look like next year on a Vision Pro. But unless you’re planning on buying a Vision Pro yourself, there’s little reason to record spatial video now, even though it’s possible, someday way down the road, you might regret not shooting that birthday party footage in 3D. I’m already thinking about I shot video footage at my niece’s bat mitzvah last week, and what it would have been like if I could see it in 3D, too. That new spatial video camera toggle is already playing on my future FOMO.

I Took 600+ Photos With the iPhone 15 Pro and Pro Max. Look at My Favorites

+31 more

See all photos

Technologies

Trump Maintains US‑Iran Negotiations Continue Amid Tehran’s Denials of Duplicity

President Trump insists that US‑Iran talks are ongoing despite Tehran’s denial of any negotiation plans, while warning that only a deal or total surrender will allow passage through the Strait of Hormuz. Conflicting statements from both sides have heightened uncertainty as the conflict enters its sixth month.

On Monday, President Donald Trump asserted that negotiations between the United States and Iran are still taking place, even after Tehran stated it has no intention of engaging in direct talks with Washington.

In a fiery Truth Social post, Trump labeled Iran’s leaders “unbelievably duplicitous,” claiming they are lying about ongoing peace talks “whether Iran wants to admit it or not.” He repeated his assertion that the United States completely controls the Strait of Hormuz, despite maritime traffic through the crucial route lingering at only a small fraction of pre‑conflict levels.

He wrote, “Nothing reaches Iran unless we allow it, and nothing will pass unless a deal—or total surrender—is achieved.”

Earlier that day, Iranian Foreign Ministry spokesperson Esmail Baghaei told reporters there is no imminent plan for U.S.–Iran negotiations, contradicting Trump’s earlier comment that talks would resume Monday afternoon. Baghaei added that Iran’s only current discussions are with Oman concerning the Strait of Hormuz.

The conflicting statements have heightened uncertainty over the peace‑talk process and the broader conflict, now in its sixth month.

Trump’s assertion about new negotiations came a day after he said on Truth Social that he had agreed to cancel a massive strike against Iran “subject to being able to rapidly make a DEAL.” He said in the same post that Iran and other Middle Eastern countries had asked him to hold off on that attack because “the perimeters of a deal has been agreed to.”

Trump has claimed dozens of times throughout the more‑than‑five‑month‑long war that a deal is at hand. No permanent deal has been signed, and a temporary ceasefire reached in June has fallen apart.

Trump has also repeatedly threatened to launch devastating strikes against Iran before backing off. After the latest example, oil prices on Monday fell and stocks surged.

BMI, a research unit of Fitch Solutions, said in a note Monday that a broader diplomatic understanding on reopening the Strait of Hormuz is still achievable this quarter, while raising the probability of its escalation scenario to 35% from 25%, citing mounting military, diplomatic and economic signs of rising U.S.-Iran tensions.

“Diplomatic progress is likely to be punctuated by periodic military flare-ups, while miscalculation by either side could trigger a renewed escalation,” BMI analysts wrote in a note. The firm said the key issue to watch is the future governance of the strait, as the Iran-Oman talks — potentially backed by Gulf states, China and the U.S. — point to efforts to build a post-conflict shipping framework.

Shipping risks persist even as diplomacy appears to be advancing. The United Kingdom Maritime Trade Operations Centre said it received a report of an incident 20 nautical miles (23 miles) northeast of Khasab, Oman — at the mouth of the strait — with a tanker’s master reporting an explosion in close proximity to the vessel at about 20:37 UTC Sunday (4:37 pm ET). The vessel and crew were safe and authorities are investigating, UKMTO said, advising ships to transit with caution.

The proposal Trump announced over the weekend calls for the U.S. and Iran to return to negotiations and continue ironing out some of the thorny issues that had derailed diplomatic efforts, according to The Associated Press, citing a regional official involved in the mediation efforts.

The official said the proposal also includes a reopening of the Hormuz Strait and halting attacks across the region, including by Iranian-backed militias in Iraq on the Arab Gulf countries and Jordan.

The U.S., for its part, will end its naval blockade on Iran and allow Tehran to export its oil, the official said, adding that no deal has been reached, although the mediation efforts remained underway.

Trump’s weekend reversal has lowered the temperature after days of escalating attacks across the Gulf. Kuwait said Saturday that Iranian forces launched a wave of drones within its airspace, with its military destroying multiple aircraft after Iran targeted critical infrastructure in the country’s north.

A parallel track with Muscat is also advancing. Iranian diplomats said Tehran was close to reaching a new arrangement with Oman to manage shipping through the Strait of Hormuz, a deal critical to preventing the war from escalating further, according to the Financial Times.

Iranian officials said negotiations over future management of the Hormuz Strait with Oman, which sits on the opposite shore of the waterway, are in their final stages. The agreed shipping route would be different from those used before, according to Iran’s Foreign Ministry spokesperson, Baghaei, adding that the new route was separate from the issue of the strait’s reopening or continued closure.

Technologies

Oil Prices Slide as Trump Halts Planned Iran Strike

Oil prices dropped after Trump cancelled a planned strike on Iran, with WTI down about 5% and Brent near 5% lower. He said the move followed requests from Tehran and regional allies for a pause while a deal shaping the Strait of Hormuz and Iran’s nuclear program is negotiated.

Oil prices fell on Monday after President Donald Trump announced he had cancelled a planned strike on Iran. WTI futures dropped roughly 5% to $80.34 a barrel, while Brent slipped about 4.7% to $83.77 a barrel.

Trump said early Sunday he called off the strike after Iran and several Middle Eastern nations asked him to hold off, noting that the outlines of a deal had been agreed upon. He added that the prospective accord would entail the immediate, full opening of the Strait of Hormuz and an end to Iran’s nuclear ambitions, according to his Truth Social post.

The president had been considering another round of strikes as diplomatic hopes waned since the conflict began on February 28. He said the U.S. and Iran would meet for talks on Monday, but Iran denied any scheduled negotiations with Washington, citing PressTV. Iran’s foreign‑ministry spokesperson Esmaeil Baghaei clarified that Tehran was only discussing shipping routes through the Strait of Hormuz with Oman. In a follow‑up Truth Social message, Trump insisted that, regardless of Iran’s acknowledgment, the United States is indeed discussing a solution to a long‑standing problem created by Iran.

Technologies

Oil Prices Drop as Trump Cancels Planned Attack on Iran

Oil prices fell sharply after President Trump announced the cancellation of a planned strike on Iran, citing a new deal that would open the Hormuz Strait and end Iran’s nuclear threat.

Oil prices fell sharply on Monday after President Donald Trump announced that he had called off a planned strike on Iran.

West Texas Intermediate futures, the U.S. benchmark, slipped roughly 5% to close at $80.34 per barrel, while Brent crude, the international benchmark, declined 4.7% to settle at $83.77 a barrel.

Trump made the announcement early Sunday, saying he had canceled the strike following requests from Tehran and other Middle Eastern countries.

In a Truth Social post, he wrote: “We have just been asked by Iran, and other Middle Eastern Countries, to hold off any attack in that the perimeters of a deal has been agreed to.”

The president indicated that the proposed agreement would include the immediate, complete, and total opening of the Hormuz Strait, as well as an end to Iran’s nuclear threat.

Trump had been weighing additional strikes amid diminishing prospects for a diplomatic resolution to the conflict that began on Feb. 28. He stated that the U.S. and Iran would hold negotiations on Monday.

Tehran denied that talks were planned with Washington, according to state news outlet PressTV.

Iran’s Foreign Ministry spokesman Esmaeil Baghaei said Tehran was only holding talks with Oman regarding the routes ships can use through the Strait of Hormuz.

In a subsequent Truth Social post, Trump added that whether “Iran wants to admit it or not, we are, in fact, talking of a solution to a problem that they have caused for decades.”