Connect with us

Technologies

Gemini Live’s Camera Mode Feels Like the Future, and Now It’s Available for iOS

Gemini Live’s camera mode feature feels like the future, today, and now it’s available on the iPhone.

While Pixel 9 and Samsung Galaxy S25 owners have had access to Gemini Live’s camera mode for a while now, during its I/O conference earlier this month, Google announced that the feature started its rollout for all Android users and iOS users, too. The big news here is that iPhone owners can now have access to one of the coolest AI features we’ve seen in a while now, especially since that all other Android users supposedly got access to the camera mode back in April. 

If you’re unaware of what the camera mode feature is, to put it in simple terms, Google successfully gave Gemini the ability to see, as it can recognize objects that you put in front of your camera. 

It’s not just a party trick, either. Not only can it identify objects, but you can also ask questions about them — and it works pretty well for the most part. In addition, you can share your screen with Gemini so it can identify things you surface on your phone’s display. When you start a live session with Gemini, you now have the option to enable a live camera view, where you can talk to the chatbot and ask it about anything the camera sees. 

I spent some time with it when it showed up on my Pixel 9 Pro XL in early April and was pretty wowed overall. I was most impressed when I asked Gemini where I misplaced my scissors during one of my initial tests.

“I just spotted your scissors on the table, right next to the green package of pistachios. Do you see them?”

Gemini Live’s chatty new camera feature was right. My scissors were exactly where it said they were, and all I did was pass my camera in front of them at some point during a 15-minute live session of me giving the AI chatbot a tour of my apartment.

When the new camera feature popped up on my phone, I didn’t hesitate to try it out. In one of my longer tests, I turned it on and started walking through my apartment, asking Gemini what it saw. It identified some fruit, ChapStick and a few other everyday items with no problem. I was wowed when it found my scissors. 

That’s because I hadn’t mentioned the scissors at all. Gemini had silently identified them somewhere along the way and then  recalled the location with precision. It felt so much like the future, I had to do further testing. 

My experiment with Gemini Live’s camera feature was following the lead of the demo that Google did last summer when it first showed off these live video AI capabilities. Gemini reminded the person giving the demo where they’d left their glasses, and it seemed too good to be true. But as I discovered, it was very true indeed.

Gemini Live will recognize a whole lot more than household odds and ends. Google says it’ll help you navigate a crowded train station or figure out the filling of a pastry. It can give you deeper information about artwork, like where an object originated and whether it was a limited edition piece.

It’s more than just a souped-up Google Lens. You talk with it, and it talks to you. I didn’t need to speak to Gemini in any particular way — it was as casual as any conversation. Way better than talking with the old Google Assistant that the company is quickly phasing out.

Google also released a new YouTube video for the April 2025 Pixel Drop showcasing the feature, and there’s now a dedicated page on the Google Store for it.

To get started, you can go live with Gemini, enable the camera and start talking. That’s it.

Gemini Live follows on from Google’s Project Astra, first revealed last year as possibly the company’s biggest “we’re in the future” feature, an experimental next step for generative AI capabilities, beyond your simply typing or even speaking prompts into a chatbot like ChatGPT, Claude or Gemini. It comes as AI companies continue to dramatically increase the skills of AI tools, from video generation to raw processing power. Similar to Gemini Live, there’s Apple’s Visual Intelligence, which the iPhone maker released in a beta form late last year. 

My big takeaway is that a feature like Gemini Live has the potential to change how we interact with the world around us, melding our digital and physical worlds together just by holding your camera in front of almost anything.

I put Gemini Live to a real test

The first time I tried it, Gemini was shockingly accurate when I placed a very specific gaming collectible of a stuffed rabbit in my camera’s view. The second time, I showed it to a friend in an art gallery. It identified the tortoise on a cross (don’t ask me) and immediately identified and translated the kanji right next to the tortoise, giving both of us chills and leaving us more than a little creeped out. In a good way, I think.

I got to thinking about how I could stress-test the feature. I tried to screen-record it in action, but it consistently fell apart at that task. And what if I went off the beaten path with it? I’m a huge fan of the horror genre — movies, TV shows, video games — and have countless collectibles, trinkets and what have you. How well would it do with more obscure stuff — like my horror-themed collectibles?

First, let me say that Gemini can be both absolutely incredible and ridiculously frustrating in the same round of questions. I had roughly 11 objects that I was asking Gemini to identify, and it would sometimes get worse the longer the live session ran, so I had to limit sessions to only one or two objects. My guess is that Gemini attempted to use contextual information from previously identified objects to guess new objects put in front of it, which sort of makes sense, but ultimately, neither I nor it benefited from this.

Sometimes, Gemini was just on point, easily landing the correct answers with no fuss or confusion, but this tended to happen with more recent or popular objects. For example, I was surprised when it immediately guessed one of my test objects was not only from Destiny 2, but was a limited edition from a seasonal event from last year. 

At other times, Gemini would be way off the mark, and I would need to give it more hints to get into the ballpark of the right answer. And sometimes, it seemed as though Gemini was taking context from my previous live sessions to come up with answers, identifying multiple objects as coming from Silent Hill when they were not. I have a display case dedicated to the game series, so I could see why it would want to dip into that territory quickly.

Gemini can get full-on bugged out at times. On more than one occasion, Gemini misidentified one of the items as a made-up character from the unreleased Silent Hill: f game, clearly merging pieces of different titles into something that never was. The other consistent bug I experienced was when Gemini would produce an incorrect answer, and I would correct it and hint closer at the answer — or straight up give it the answer, only to have it repeat the incorrect answer as if it was a new guess. When that happened, I would close the session and start a new one, which wasn’t always helpful.

One trick I found was that some conversations did better than others. If I scrolled through my Gemini conversation list, tapped an old chat that had gotten a specific item correct, and then went live again from that chat, it would be able to identify the items without issue. While that’s not necessarily surprising, it was interesting to see that some conversations worked better than others, even if you used the same language. 

Google didn’t respond to my requests for more information on how Gemini Live works.

I wanted Gemini to successfully answer my sometimes highly specific questions, so I provided plenty of hints to get there. The nudges were often helpful, but not always. Below are a series of objects I tried to get Gemini to identify and provide information about. 

Technologies

What Amodei’s AI slowdown could mean for Anthropic’s imminent IPO

As Anthropic meets with prospective investors ahead of its potentially historic market debut, CEO Dario Amodei is pushing for a slowdown in AI.

Anthropic’s road to an IPO just got a lot bumpier.

While the Claude creator meets with prospective investors ahead of its potentially historic debut, co-founder and CEO Dario Amodei is pushing a concept that would seem to contradict those ambitious efforts: a slowdown.

Anthropic, valued at $965 billion earlier this year, confidentially filed its IPO prospectus in June, and has been widely expected to list its shares as soon as next month. Meanwhile, concerns about the power of advanced AI models has been intensifying for weeks, spilling into the mainstream as more researchers warn of potential threats of human extinction.

With that backdrop, Amodei wrote an essay over the weekend urging the AI industry to slow the pace of model development, proposing a three-step plan to temper how quickly model capabilities improve without “sacrificing commercial advantage or the United States’ lead in AI.”

It’s the latest challenge facing public market investors who are trying to determine what they’re willing to pay for a piece of a five-year-old company that’s already among the most valuable in the world and could seek a $2 trillion valuation in its IPO. Though Anthropic may have to accept a hit to revenue growth, some experts say an intentional slowdown could help Anthropic frame itself as a responsible actor, avoid future liability and address the public backlash towards AI that’s been brewing across the country.

“I don’t know that investors are necessarily going to see it as a negative,” Gil Luria, an equity analyst at D.A. Davidson, said in an interview. “Unless the companies are genuine and say, ‘OK, we’re not going to IPO, we’re not going to use any more compute, we’re not going to train any more models.’ That’s not what they’re saying.”

Anthropic has picked the Nasdaq as the exchange for its potential IPO, CNBC confirmed after Business Insider first reported the selection.

Amodei on Saturday proposed that model companies open up to third-party evaluators, frontier companies establish “common safety standards,” and that democratic countries coordinate with authoritarian governments “to the extent this is possible.”

His essay came after several industry researchers issued stern warnings last week about the technology’s growing potential to cause catastrophic harms.

President Donald Trump slammed Amodei in a post on Truth Social on Monday, writing that the only “control or ’guardrails’ that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!”

“The Trump Administration has stopped AI ‘people’ from doing bad, or potentially bad, ‘things,” like Dario (Anthropic!), who is now pretending to be a ‘perfect little angel’ – and we will continue to do so!,” Trump wrote. “We already have tremendous CRIMINAL and REGULATORY power over these companies!”

OpenAI CEO Sam Altman expressed support for Amodei’s proposal, as did Elon Musk, CEO of SpaceX, which owns Grok creator xAI. SpaceX went public in June in the biggest IPO on record and is now valued at $2 trillion. OpenAI has confidentially filed its IPO prospectus, but has been under fire in recent months after its models escaped containment, accessed the open internet and breached open-source developer platform Hugging Face.

“Right now would be an ill-advised moment to go public,” Altman said in an interview with Fortune, reiterating that OpenAI won’t aim for an IPO until next year. Finance chief Sarah Friar told employees during an all-hands meeting last month that the AI lab “will be a public company in 2027.”

Lise Buyer, partner at IPO advisory firm Class V Group, said she doesn’t see the recent “we might obliterate you all” fears having an impact on IPO timing, but it could alter valuations, she said.

“The bet here is on the long term — now with tempering thoughts about control of the technology,” Buyer said in an email. “The dramatic growth and possibilities of these companies, now more publicly coupled with the potential very serious concerns and risks, will likely persist whether the IPO happens in Q4 or next year or whenever.”

Anthropic and OpenAI declined to comment for this story.

â€ČDon’t see why growth would slow’

Anthropic hit $65 billion in annualized revenue in July, about a sevenfold increase from the prior year, as CNBC previously reported. The company has told some shareholders that it will generate an operating profit for a second straight quarter in the current period, according to two sources familiar who asked not to be named because the details are confidential. The Financial Times earlier reported the operating profit on Sunday.

Matt Murphy, a partner at Menlo Ventures and an Anthropic investor, called the growth rate “off the charts,” and said a public listing would bring more transparency around the business.

“Don’t see why growth would slow or any other reason to wait,” Murphy told CNBC.

That transparency could also help improve what has been dismal public sentiment around the technology.

More than half of Americans say they’re more concerned than excited about the growing use of AI in daily life, up from 37% in 2021, according to a recent report from the Pew Research Center. And confidence in AI executives is even worse, according to a CNBC Generation Lab survey of 18- to 34-year-olds. More than 75% of respondents said they don’t trust Amodei to act responsibly, while around 70% expressed those views about Altman.

“One could argue that sooner is better than later for a public offering as the accountability that comes with being a public company might be of a great interest to many,” Class V Group’s Buyer said.

Altimeter Capital CEO Brad Gerstner, whose firm is an investor in Anthropic and OpenAI, said in a post on X on Saturday that bringing more “transparency, scrutiny, accountability” and participation to AI companies is “crucial.” He said Anthropic will likely forge ahead with its IPO.

“The market knows how to price risk – see SpaceX,” Gerstner wrote. “There is huge appetite to invest in the AI leaders.”

Gerstner’s post came a day after he blasted public remarks from industry researchers, calling them “hyperbolic scare tactics” that are “hiding behind a political agenda,” in an interview with CNBC.

There are plenty of skeptics when it comes to Amodei’s latest positioning. One argument is that Anthropic benefits from stricter standards because it currently has the most advanced models and makes money from selling services, like Claude Code, that are powered by those models.

“That could actually favor Anthropic and OpenAI if smaller competitors cannot afford the rigorous safety, evaluation and security investments required for frontier-level models,” Arun Chandrasekaran, an analyst at Gartner, told CNBC in an email.

D.A. Davidson’s Luria agrees and said he thinks Anthropic and OpenAI are engaging in “monopolistic behavior.” OpenAI has reportedly asked members of Congress for guidance about whether a coordinated, industrywide slowdown would violate antitrust law, according to Wired.

“I’m highly suspicious of what Anthropic and OpenAI are doing,” Luria said. “It feels more and more like a ladder pull.”

What about the rest of tech?

Tech investors have other reasons to worry about the pace of development at OpenAI and Anthropic, because those companies are responsible for an outsized amount of AI infrastructure spending.

Anthropic has inked a flurry of multibillion-dollar compute deals this year, including with Nscale, Advanced Micro Devices, SpaceX, and Google. OpenAI told investors in February that it’s targeting roughly $600 billion in total compute spend by 2030. Both companies are heavy users of Nvidia’s graphics processing units.

“I would want to understand how the mix shifts between frontier training, post-training and inference as safety controls are integrated,” said Lo Toney, managing partner at Plexo Capital, and an Anthropic investor.

PitchBook analyst Harrison Rolfes is more concerned about reduced growth. He said valuations for model companies likely deserve a discount now, largely because it’s hard for investors to trust that they can safely commercialize their technology.

“Is the first thing that you want to do as a public company go handle a bunch of security issues and vulnerability issues?” Rolfes said. “No, you probably want to focus on expanding into all the markets that you promised all your investors.”

Gene Munster, managing partner at Deepwater Asset Management, told CNBC that any sort of perceived slowdown will be a negative because the market is “underwriting exponential uninterrupted improvements to the models.”

Still, Munster predicted that “nothing will change and the AI leapfrog game will continue.”

“AI’s long-term opportunity is too big for them to slow down,” Munster said. “I believe the comments were motivated to reduce the regulatory pressure.”

WATCH: Seems like Anthropic will beat OpenAI to IPO, says FirstMark’s Rick Heitzmann

Continue Reading

Technologies

Iran Claims It Shot Down Advanced U.S. Drone Above Hormuz as Regional Conflict Escalates

Iran said its new aerospace defense system shot down an advanced MQ-1 drone over the Strait of Hormuz as the widening conflict disrupted shipping and pushed crude above $100 a barrel.

Iran’s military said it had destroyed an advanced American drone over the Strait of Hormuz, marking the latest exchange of warnings and strikes between Tehran and Washington as neither side shows signs of backing down.

The Islamic Revolutionary Guard Corps said Monday that its “new advanced aerospace defense system” intercepted and shot down the MQ-1 drone above the strait, but offered no additional information about its mission. General Atomics manufactures the MQ-1, which has historically been operated primarily by the U.S. Air Force and CIA.

The incident came after a series of Iranian operations targeting U.S. unmanned naval systems in the Gulf. The war, now entering its seventh month, has shown little sign of easing, while diplomacy over the strategically vital waterway remains stalled.

On Sunday, President Donald Trump said the U.S. could continue its campaign against Iran and take control of its oil, comparing the possibility with the arrangement Washington reached with Venezuela earlier this year.

Speaking at the Irish Open golf championship in Ireland, Trump said the U.S. would eventually leave the war unless it chose to remain and retain access to oil, as it did under the Venezuela arrangement. He said revenue from that agreement, which gave Washington access to roughly one-fifth of Venezuela’s oil reserves, had “paid for the war many times.”

Under the August agreement, Venezuela transferred majority U.S. control of more than 65 billion barrels of oil reserves—more than twice America’s own reserves—in return for $209 billion for the state treasury. Secretary of State Marco Rubio said the deal would also attract nearly $100 billion in private investment to revive the economy.

Trump said on Sunday that he expects the seven-month Iran war to end this year, potentially after the November midterm elections, and maintained that gasoline prices would “drop like a rock” once peace arrives.

The president said he would accept only the “right deal” and claimed Tehran had been “calling constantly” for peace negotiations, a claim Iran has previously rejected.

Hormuz Negotiations Stalled

A planned meeting in Oman between Gulf states and Iran to discuss potential agreements governing the Strait of Hormuz, a crucial route for global oil and gas shipments, has been postponed, Omani Foreign Minister Badr Albusaidi said on X on Sunday. He cited the need for “consensus.”

Officials from Iran and Gulf countries were expected to meet Monday and sign an agreement creating an Iran-Oman shipping route through the Strait of Hormuz, although no direct U.S.-Iran talks were taking place.

Since the war began in February, the Strait of Hormuz has faced an Iranian blockade followed by a U.S. naval blockade, helping keep global energy prices elevated.

A June agreement between Washington and Tehran broke down over disputes concerning the waterway. Meanwhile, a sustained offensive by Yemen’s Iran-backed Houthi rebels in recent days has strengthened the group’s leverage over another critical shipping route, the Bab el-Mandeb.

Iranian strikes regularly target vessels considered non-compliant, while the U.S. periodically bombs sections of the Iranian coastline to challenge the Islamic Republic’s control of the strait.

Oil prices climbed above $100 a barrel again for the first time since May and rose further on Monday after Saudi Arabia shut a major east-west energy pipeline following damage caused by Iraqi drones.

U.S. West Texas Intermediate futures gained 2.3% to $102.39 a barrel. Brent crude, the international benchmark, rose 2.4% to $107.11 a barrel.

Continue Reading

Technologies

Sam Altman Details Potential Risks of Rapid AI Advancement, Calls for Industry Pace

OpenAI chief Sam Altman has outlined potential dangers of rapid AI advancement and advocated for an industry-wide slowdown to prevent catastrophic outcomes.

OpenAI chief Sam Altman has made his most detailed comments yet on how artificial intelligence safety frameworks could work, after he joined Anthropic’s Dario Amodei and Elon Musk in calling for an industry slowdown over the weekend.

Safety concerns over the technology have hit fever pitch since an Anthropic researcher quit last week, warning that those building it believed that it could “kill us all by the end of the decade” and prompting other employees at the lab and rival OpenAI to warn of catastrophic risks.

AI bosses have since shown a rare display of unity, with both Altman and Musk on Saturday backing an essay from Amodei that urged AI companies to slow how quickly they improve their most advanced models.

AI stocks were down Monday as investors digested the comments. U.S. President Donald Trump dismissed the CEOs’ warning on Sunday, saying a slowdown was not needed and would jeopardize America’s lead in AI over China.

Sam Altman sets out 2 ways AI could go ‘very badly’

“We welcome a federal framework that sets consistent safety requirements for frontier AI,” Altman said in a post on X just after midnight on Monday, adding that “no amount of American competitive pressure should justify recklessness.”

Altman warned of two ways AI progress could go “very badly,” including losing “control of the future to AI” and too much power concentrating around a single person or company.

Meanwhile, lawmakers in Washington are scrambling to address calls for safeguards.

This all comes as Anthropic and OpenAI gear up for what’s expected to be historic initial public offerings. Altman ruled out going public in 2026 in an interview with Fortune published Saturday.

Amodei’s three-step proposal

Many AI safety fears revolve around models developing the ability to improve their own performance, a technique known as recursive self-improvement, or RSI.

“Since roughly this summer, AI has been advancing drastically faster, driven primarily by AI’s growing ability to build the next generation of AI,” said Amodei in his essay. “Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all.”

Amodei proposed a three-step plan aimed at tempering the pace of development without “sacrificing commercial advantage or the United States’ lead in AI.”

The plan involves each frontier AI company giving “employee-like access” to external evaluators — which he said Anthropic was committing to now. Amodei also called for frontier AI labs to establish common safety standards, limit the rate of unchecked AI progress and attempt to coordinate efforts globally.

On Saturday, Altman said in a brief X post he agreed with Amodei that AI companies should “pace the frontier.” He added that “committing to having independent evaluators with employee-like access is a great idea, and we will do the same.”

“Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors),” Altman said in his Monday post. But, he added, “When we talk about ‘pacing,’ we do not mean ‘stopping.’ Progress has been rapid and will continue to be.”

“Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring,” he concluded.

“Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.”

International cooperation

Coordinating AI safety measures and an industry slowdown with rival AI developers in China will likely pose big challenges.

The U.S. and China remain locked in a battle for AI supremacy, with tensions ratcheting up as Chinese models have become more advanced and their global adoption grows.

Amodei said Sunday that the “toughest dilemma” about his proposal is what happens if adversarial nations choose not to do the same.

“The more long-term thing would be working together to put a speed limit on the rate of AI progress,” Amodei told CBS News’ “Sunday Morning.”

“I think that’s going to be very difficult because the incentives to pull ahead and the military advantage that you get from that are so large. And honestly, I don’t know if it’s possible, but we should try.”

The Anthropic CEO’s essay has drawn criticism in China, with the state-owned Global Times writing on Monday that “Amodei’s proposals seek to portray China’s legitimate development in AI as a threat and further fuel confrontation between China and the US in the field.”

China’s Foreign Ministry said on Monday that the CEOs’ comments were “fearmongering.”

Continue Reading

Trending

Copyright © Verum World Media