Connect with us

Technologies

Gemini Live Now Has Eyes. We Put the New Feature to the Test

The new feature gives Gemini Live eyes to «see.» I put it through a series of tests. Here are the results.

There I was, walking around my apartment, taking a video with my phone and talking to Google’s Gemini Live. I was giving the AI a tour – and a quiz, asking it to name specific objects it saw. After it identified the flowers in a vase in my living room (chamomile and dianthus, by the way), I tried a curveball: I asked it to tell me where I’d left a pair of scissors. «I just spotted your scissors on the table, right next to the green package of pistachios. Do you see them?»

It was right, and I was wowed. 

Gemini Live will recognize a whole lot more than household odds and ends. Google says it’ll help you navigate a crowded train station or figure out the filling of a pastry. It can give you deeper information about artwork, like where an object originated and whether it was a limited edition.

It’s more than just a souped-up Google Lens. You talk with it and it talks to you. I didn’t need to speak to Gemini in any particular way – it was as casual as any conversation. Way better than talking with the old Google Assistant that the company is quickly phasing out.

Google and Samsung are just now starting to formally roll out the feature to all Pixel 9 (including the new, Pixel 9a) and Galaxy S25 phones. It’s available for free for those devices, and other Pixel phones can access it via a Google AI Premium subscription. Google also released a new YouTube video for the April 2025 Pixel Drop showcasing the feature, and there’s now a dedicated page on the Google Store for it.

All you have to do to get started is go live with Gemini, enable the camera and start talking.

Gemini Live follows on from Google’s Project Astra, first revealed last year as possibly the company’s biggest «we’re in the future» feature, an experimental next step for generative AI capabilities, beyond your simply typing or even speaking prompts into a chatbot like ChatGPT, Claude or Gemini. It comes as AI companies continue to dramatically increase the skills of AI tools, from video generation to raw processing power. Somewhat similar to Gemini Live, there’s Apple’s Visual Intelligence, which the iPhone maker released in a beta form late last year. 

My big takeaway is that a feature like Gemini Live has the potential to change how we interact with the world around us, melding our digital and physical worlds together just by holding your camera in front of almost anything.

I put Gemini Live to a real test

Somehow Gemini Live showed up on my Pixel 9 Pro XL a few days early, so I’ve already had a chance to play around with it. 

The first time I tried it, Gemini was shockingly accurate when I placed a very specific gaming collectible of a stuffed rabbit in my camera’s view. The second time, I showed it to a friend when we were in an art gallery. It not only identified the tortoise on a cross (don’t ask me), but it also immediately identified and translated the kanji right next to the tortoise, giving both of us chills and leaving us more than a little creeped out. In a good way, I think.

In the tour of my apartment, I was following the lead of the demo that Google did last summer when it first showed off these Live video AI capabilities. I tried random objects in my apartment (fruit, books, Chapstick), many of which it easily identified. 

Then I got thinking about how I could stress-test the feature. I tried to screen-record it in action, but it consistently fell apart at that task. And what if I went off the beaten path with it? I’m a huge fan of the horror genre — movies, TV shows, video games — and have countless collectibles, trinkets and what have you. How well would it do with more obscure stuff — like my horror-themed collectibles?

First, let me say that Gemini can be both absolutely incredible and ridiculously frustrating in the same round of questions. I had roughly 11 objects that I was asking Gemini to identify, and it would sometimes get worse the longer the live session ran, so I had to limit sessions to only one or two objects. My guess is that Gemini attempted to use contextual information from previously identified objects to guess new objects put in front of it, which sort of makes sense, but ultimately neither I nor it benefited from this.

Sometimes, Gemini was just on point, easily landing the correct answers with no fuss or confusion, but this tended to happen with more recent or popular objects. For example, I was pretty surprised when it immediately guessed one of my test objects was not only from Destiny 2, but was a limited edition from a seasonal event from last year. 

At other times, Gemini would be way off the mark, and I would need to give it more hints to get into the ballpark of the right answer. And sometimes, it seemed as though Gemini was taking context from my previous live sessions to come up with answers, identifying multiple objects as coming from Silent Hill when they were not. I have a display case dedicated to the game series, so I could see why it would want to dip into that territory quickly.

Gemini can get full-on bugged out at times. On more than one occasion, Gemini misidentified one of the items as a made-up character from the unreleased Silent Hill: f game, clearly merging pieces of different titles into something that never was. The other consistent bug I experienced was when Gemini would produce an incorrect answer, and I would correct it and hint closer at the answer — or straight up give it the answer, only to have it repeat the incorrect answer as if it was a new guess. When that happened, I would close the session and start a new one, which wasn’t always helpful.

One trick I found was that some conversations did better than others. If I scrolled through my Gemini conversation list, tapped an old chat that had gotten a specific item correct, and then went live again from that chat, it would be able to identify the items without issue. While that’s not necessarily surprising, it was interesting to see that some conversations worked better than others, even if you used the same language. 

Google didn’t respond to my requests for more information on how Gemini Live works.

I wanted Gemini to successfully answer my sometimes highly specific questions, so I provided plenty of hints to get there. The nudges were often helpful, but not always. Below are a series of objects I tried to get Gemini to identify and provide information about. 

Technologies

Invincible VS Is a Tag-Team Brawler Packed With Bloody Superhero Carnage

The Invincible franchise is heading to Xbox.

Microsoft’s Xbox Games Showcase had its share of surprises, including a new game from Pokemon developer Game Freak and the ROG Xbox Ally portable handheld. Another surprise is a fighting game featuring characters from the Invincible comic and show. 

Invincible VS is a three-versus-three tag fighting game featuring characters from the Invincible universe. The trailer showed several characters from the show, including Invincible, Omni-Man, Atom Eve, Rex Splode, Bulletproof, and two Viltrumites — the powerful alien species Omni-Man and Invincible belong to.

The game itself has a comic book art style to it, but its action is more along the lines of Mortal Kombat. The fighting is very bloody, which is faithful to the comic and show, but no kind of fatalities were shown in the trailer. There are also a couple of familiar settings from the show. While we saw only a handful of characters in this first glimpse of Invincible VS, there is a wealth of heroes and villains that could be added to the game before it launches. 

Robert Kirkman’s Invincible
 started as a comic in 2003 and ended its run in 2018. In 2021, an animated series based on the comic made its debut on Amazon Prime Video. The show wrapped up its third season in March and has already been renewed for a fourth season

Skybound Games is publishing Invincible VS with development handled by Quarter Up, an in-house studio led by members of the team that created 2013’s Killer Instinct. 

Invincible VS will be released sometime in 2026 for PC and Xbox Series consoles. 

Continue Reading

Technologies

I Played With the ROG Xbox Ally, the Upcoming Xbox Handheld

The new handheld console was revealed during the Xbox Games Showcase, and I got to spend some time with my hands on it.

Microsoft revealed its long-rumored Xbox handheld console running Windows 11 during the Xbox Games Showcase — two models called the ROG Xbox Ally and ROG Xbox Ally X — and I spent a short time playing around with one soon after. 

Unfortunately, I wasn’t allowed to take any pictures or videos of the demo since the hardware we got to test wasn’t final. That became evident when our designated guide had HDMI connection issues with the unit. I was able to play around with the Xbox full-screen experience and the various settings menus and play the beginning minutes of Gears of War Reloaded, which comes out this summer.  

The device is quite comfortable to hold, with slightly textured grips. The face buttons, triggers and analog sticks all felt familiar, very similar to what I’m used to on an Xbox controller. 

What’s really exciting is that you can download your games, remote play from your Xbox or stream from the cloud, making this more useful than PlayStation’s Portal, which can only stream and play remotely. That’s one of the major benefits of being inside Xbox’s ecosystem: You can play a game on any of its devices, regardless of where you bought it, whether that be Xbox consoles, PC, cloud or this new handheld. This more open-platform approach makes the Xbox Ally closer in spirit to a Steam Deck compared with a Nintendo Switch, which can only run Nintendo games. 

When it ships — expected in time for the winter holidays — you’ll be able to navigate via a full-screen Xbox app, which combines your Xbox game library with installed games from several other marketplaces into a single Xbox experience. The company specifically mentioned Xbox, Game Pass, battle.net (owned by Microsoft) and «other leading PC storefronts,» which I’m hoping includes Steam. Much like on an Xbox, each game has icons depicting which platform they’re from. In my demo, the only example of a different storefront was Hearthstone, which had a battle.net icon. 

The Xbox Ally consoles use the Game Bar, and if you’ve used the Xbox app on PC, then you’ll find it familiar. In fact, pressing the new Xbox button opens an almost identical version of the guide when playing Xbox games on PC. However, there’s also a new Command Center tab on the far left to adjust settings for power consumption and performance, similar to what we’ve seen on Steam Deck.

In Game Bar, you can quickly jump to the home screen, your library, launch games, open apps, chat with friends, adjust settings and more. And this Game Bar works alongside Asus’s Armoury Crate overlay. This is a little worrisome, as Armoury Crate has usually felt more like unnecessary bloatware, but when we get to test the device later this year we’ll see if Asus has stripped it down to the relevant functions rather than just added more on top.

Since it’s a Windows 11 device, you’ll also be able to launch and use apps like Discord and Twitch and access game mods. The Xbox Ally boots directly into the «Xbox full screen experience» similar to how a Steam Deck launches into Big Picture mode. The full-screen experience is optimized specifically for handheld gaming, and Xbox told me the device minimizes background activity and allocates more system resources to gameplay like Game Mode does on Windows. This means more memory and potentially higher framerates for your games.

The ROG Ally and Ally X have been out for a bit now, but the Xbox models have some unique features. In addition to the Xbox button, the ROG Xbox Ally also has larger, contoured grips. The previous ROG Ally is more rectangular; the Xbox Ally is closer to the design of the PlayStation Portal, with dedicated, slightly separated hand grips that mimic the look and feel of a standard game controller. They also have upgraded components over the Asus versions.

The handheld comes in two options, a white Xbox Ally and the more powerful Xbox Ally X that comes in black. The lower-end Ally is powered by an AMD Ryzen Z2A processor, comes with 16GB of RAM and 512GB of SSD storage, weighs 23.6 ounces (670 grams) and has a 60Wh battery. The Ally X has an AMD Ryzen AI Z2 Extreme processor, 24GB of RAM, 1TB of SSD storage, weighs a bit more at 25.2 ounces (715 grams) and has an 80Wh battery. 

Both models are equipped with a 7-inch,120Hz 1080p screen, the same as on the original Asus versions of the devices. They also have RGB lights surrounding the analog sticks, something I hope I’ll be able to turn off when I spend some real time playing on the device. The Ally X did feel on the heavier side, but then again, the recently released Switch 2 and my Steam Deck OLED are also pretty heavy, so I think that’s just what handhelds weigh these days.

Xbox hasn’t yet revealed  the pricing or release date, aside from «this holiday.»

Continue Reading

Technologies

Everything I Suspect Will Be Announced at WWDC 2025 Monday

We could see new iPhone, Mac and Apple Watch software called iOS 26, MacOS Tahoe and WatchOS 26. Apple is rumored to overhaul all of its OSes with a unifying visual interface.

Apple’s developer conference, WWDC 2025, kicks off Monday at 10 a.m. PT. At its last two WWDC events, Apple launched itself into new territories, jumping into both AR/VR and generative AI. There’s pressure on the company to match, if not top, what it’s done in the past. CNET has editors and writers attending in person to report on live WWDC 2025 developments as they break.

There was the Vision Pro in 2023, and then Apple Intelligence in 2024. What big announcement is coming in 2025? With both the Vision Pro and Apple Intelligence having faced slow and heavily criticized starts, the big message at this year’s WWDC doesn’t seem clear at all. Apple might focus on operating system redesigns and gradual improvements across the board.

WWDC is usually a showcase for Apple’s future-forward ideas. It’s also where the company discusses its developer tools, as you’d expect. And it’s where previews of all the new OS versions are revealed, giving an early look at what’s coming to the iPhone, iPad, Mac and other Apple devices.

It’s possible Apple will reveal a new home device — a display-enabled HomePod — or even a new Apple Pencil with a calligraphy mode. But the biggest rumors so far suggest a new cross-OS redesign and renaming that could be Apple’s way of deflecting some attention away from not having big new AI features to show off.

OS by year: Will it be iOS 26?

Recent reports from Bloomberg’s often-correct Mark Gurman say Apple is going to ditch the existing numbered OS convention it’s used for years and instead go with another approach to naming: labeling all annual OSes by year number. Instead of iOS 19, we’ll have iOS 26. And iPadOS 26, and MacOS 26, and WatchOS 26, TVOS 26, VisionOS 26. Samsung made a similar move in 2020, jumping from the Galaxy S10 in 2019 to the Galaxy S20 in 2020.

Apple’s numbering has felt pretty disjointed as the numbers have gone ever-higher across multiple device categories. A yearly number would at least help people know if they’re on the current version. 

Glass as the new look

The WWDC invites, featuring a hazy transparent ring, hint at a reported redesign of all the company’s software to a new «glass» look. Bloomberg’s Gurman reported on a large incoming cross-OS design shift, calling it a dramatic redesign and one of the biggest Apple’s done in years. The design may mirror the Vision Pro’s VisionOS feel, which has lots of frosted glass panes, layers of transparency and circular app icons. Front Page Tech’s Jon Prosser showed a preview of the expected design based on information from his sources, and it definitely looks VisionOS-esque.

Beyond a coat of paint, will the OSes start to feel more similar in function too? I’m particularly curious about how iPadOS and MacOS start to close in on each other even more. Apple’s iPad has slowly inched toward acting like a computer, with features like Stage Manager for multitasking, and it’s felt inevitable that the tablet line would eventually provide a comparable experience to the MacBook.

WatchOS should get Apple Intelligence, and the Health app may be part of it

One of the devices that’s missed out on Apple Intelligence so far has been the Apple Watch, and that should be changing soon. Apple is expected to put more AI on the next Watch OS, which could help with message summaries, translation and maybe even composing messages. It could also bring overdue health and fitness upgrades. Reports say Apple could be working on adding generative AI insights to its Health app data and even using AI as a medical service, with a launch target of 2026. Health could possibly get a paid subscription tier, similar to Fitness and what many of Apple’s current services are adding. This could be like what Google is doing with Wear OS, which has long used Fitbit Premium as a health subscription (a broader Gemini rollout is on the way too). 

I like AI coaching and insights on a watch, but I don’t like subscriptions. We’ll see what happens, and if Apple gets into any of these future plans at this WWDC.

Battery life boosts

Another recent report (again, Gurman) says AI will help Apple improve battery life on its devices. How many devices? The iPhone, but hopefully the Apple Watch, too — these are the products in the lineup that I find I need to charge more than I’d like. For me, at least, iPads and Macs are mostly fine on battery life as is, but I’ll never refuse longer battery life for anything.

Apple has made gradual boosts to its battery features over time, but maybe there will be more intelligently applied power modes this time.

Game news?

Apple may be pushing the importance of games again, just as the Nintendo Switch 2 debuts. Bloomberg reports that the company could release a new app to act as a hub for games and game services including Apple Arcade, becoming an overdue overhaul of Game Center.

A number of game controller accessories, like Backbone, already have app hubs that function as game launchers, but Apple has never done much to help organize games on its devices in a way that feels more like what you find on a console. A new app seems like a good fit for those types of controllers, too.

Apple just acquired its first game studio: RAC7, the developers of hit Apple Arcade game Sneaky Sasquatch.

Apple could also have VR gaming news, if older reports come true: PlayStation VR 2 controllers have been expected to work with Vision Pro headsets, in a push to expand gaming on Apple’s VR/AR headset. Maybe that’ll be part of a push to get more developers onboard, as Apple could be readying a less expensive version of the Vision Pro in the next year. Right now the headset can’t compete with Meta’s more affordable Quest headsets in the gaming department.

AI: Live translation, and maybe Vision camera advancements

Apple opened up camera access to enterprise developers last year, and now it’s time for AI tools to emerge for everyone else — tools that could help describe what you’re seeing, or help you remember things too. Apple has already added assistive support for some camera-enabled functions on the Vision Pro and other products, suggesting more to come.

Though Apple’s WWDC keynote presentation isn’t expected to include many announcements of AI strides, the company still needs to compete with Google, Open AI, Perplexity and many others who are making such strides. Reports say live translation will come to some AirPods models, which would mirror what Google and Meta have been doing on glasses and earbuds and on phones.

The biggest VisionOS move I’d expect to see is some introduction of camera-aware AI. Apple Intelligence debuted on Apple’s VR/AR spatial computer headset earlier this year, but none of the AI can take advantage of the system’s cameras to «see» what you’re seeing. At least not yet. Google’s use of Gemini to access the cameras on upcoming headsets and glasses, and Meta’s support of camera access for Quest developers (and its expanding AI tools on Ray-Bans), suggest Apple needs to move this way now to begin paving a way for camera-aware AI to work on future headsets and eventually glasses. 

Apple Pencil

We could see either a brand-new Apple Pencil or updated features that make the current device feel new, according to a report from Bloomberg. Expect to see a new a digital reed calligraphy pen feature unveiled. It’s unclear whether this new software will be for both the original Apple Pencil and the Apple Pencil 2, or if we’ll actually see a brand-new version of the stylus.

A new HomePod-slash-iPad?

There could be a new product emerging at WWDC: a look at a long-expected screen-enabled HomePod that may be part of a bigger push into smarter smart home tech. Reports suggest it’ll be something like a HomePod now — speaker-enabled, with an array of mics — but with a touchscreen. Would it be a screen big enough to act as a photo frame, or something more like a control panel? Where would this thing live, exactly? And what would it cost? Originally, reports of this device even suggested a robotic arm that would allow the screen to follow your face, but those plans seem to be off the table for now.

Of all the wild-card product ideas Apple could announce at this show, this seems the most likely.

WWDC/Gurman potpourri

There are, of course, a number of other rumors from Gurman. Here are some that caught our attention:

  • Messages app: iOS could get the ability to add backgrounds to chats and group chats.
  • iPadOS: Apple may reveal an iPadOS version of the Preview app.
  • iPadOS: MacOS-like multitasking might come to the iPad.
  • iPhone Camera app: The interface could get an overhaul focused on making it simpler to use.

We’ll know more soon

WWDC is happening June 9, with the keynote video presentation streaming at 10 a.m. Pacific. We’ll be there at Apple Park, too, covering it in person. We’ll know more about how all this software could be hinting at new products, and get a check-in on where exactly Apple is with its AI strategies. And maybe we’ll get a bit of product news, too — you never know.

Continue Reading

Trending

Copyright © Verum World Media