Technologies

Galaxy S23 Ultra’s Secret Weapon Could Be This New Samsung Chip

Exclusive: Samsung’s Isocell HP2 image sensor can shoot photos at 12.5, 50 or even 200 megapixels thanks to new pixel binning options.

With its new 200-megapixel Isocell HP2 image sensor, Samsung will try to give smartphone photographers the best of both worlds: high resolution and good image quality in challenging conditions.

The HP2 is in mass production. Samsung has neither announced its shipment date nor confirmed which phone it will arrive in. Still, the sensor is expected to power the main camera on the company’s flagship Galaxy S23 Ultra phone, likely to debut Feb. 1.

Image sensor designers face a tradeoff. Increasing resolution means each pixel on the sensor is smaller, and smaller pixels aren’t able to gather light as well. That means shots taken in low light are marred by noise speckles. They lose detail in shadowed parts of a scene. And they suffer blown-out highlights in bright areas like skies.

The HP2, though, brings new methods to counteract those problems and make the most of each photon of light, Samsung revealed exclusively to CNET.

The South Korean electronics giant’s sensor can gather light more effectively in the first place, boost high dynamic range (HDR) photos to cope better with scenes with dark and bright elements, the company said. And when shooting at the full 200-megapixel resolution, Samsung uses AI technology to help render the finest details.

It’s not yet clear how well the sensor will perform in real-world testing. But it’s no surprise Samsung is focusing on the technology. Camera improvements are a prime reason to upgrade phones, with better photos and videos more noticeable than marginally better processors, battery life and network technology.

«The full 200MP resolution especially shines when shooting at concerts or outdoors where there’s lots of detail to be captured,» said JoonSeo Yim, executive vice president of Samsung Electronics’ sensor business. «It may not be the predominant setting for most consumers, but we definitely see the need for highly detailed images.»

Apple, Samsung’s top smartphone rival, is likewise investing heavily in its cameras. Comparatively large lens elements protrude from the back of iPhone 14 Pro models to show off camera performance, and Apple has upgraded its sensors for better high-resolution and low-light shooting.

Better pixel binning options

One of the headline techniques for improving smartphone photos is called pixel binning. With it, groups of physical pixels can be combined into larger virtual pixels that gather more light when it’s dim, trading off resolution for lower noise and better color.

Samsung isn’t alone in using pixel binning. You’ll see it in the Apple iPhone 14 Pro, Google Pixel 7, Xiaomi 12T Pro and other phones, but the HP2 sensor is one of the most advanced. Apple and Google, for example, use 2×2 pixel binning that turn four physical pixels into one virtual pixel. Samsung’s flagship Galaxy S22 phones have offered 3×3 pixel binning since 2019, offering 108 megapixel photos in good light and 12-megapixel photos when it’s dim.

Samsung’s HP2 can take 200-megapixel photos under good conditions. When it’s dimmer, pixel binning groups pixels into 2×2 chunks for a 50-megapixel image. And when dimmer yet, Samsung’s 4×4 «Tetra2pixel» chunks take a 12.5-megapixel photo.

The two levels of pixel binning were available on the 200-megapixel HP3, announced in 2022. However, the HP3 uses smaller pixels that, while minimizing camera bulk, aren’t as good at capturing light in the first place. The HP1, announced in 2021, also had it. But the HP2 adds some other tricks the HP1 lacks.

Pixel binning ups and downs

Pixel binning has some other advantages. Cameras can crop in on the central portion of the image to zoom into more distant subjects. It’s a key foundation to the effort to give smartphones zoom abilities like traditional camera lenses. Pixel binning also opens up new options for high resolution 4K and 8K video.

Pixel binning has downsides, though. It takes a lot of battery power to process all those pixels, and storing high-resolution photos gobbles up a lot of storage space. And high-resolution sensors, while nice in principle, don’t achieve top image quality unless they’re paired with high-quality lenses.

«The full 200MP mode does require more RAM and power,» Yim said, which is why such high resolution sensors are only found on high-end smartphones.

One complication with the HP2 is figuring out color when shooting 200 megapixel photos. Digital cameras capture either red, green or blue light for each pixel, but the Tetra2pixel design means each 4×4 pixel group captures only one of those colors. To help fill in the color detail needed within those 16-pixel groups, Samsung uses an artificial intelligence algorithm, the company said.

Samsung HP2’s image quality improvements

The sensor has other tricks to boost image quality, particularly with high dynamic range scenes with both bright and dark details. Here are a few:

A technology called Dual Voltage Transfer Gate (D-VTG) gives each pixel a 33% better ability to gather light, which should improve image quality in dim scenes and cut back on washed-out white patches in bright skies.
Samsung’s Dual Slope Gain (DSG) feature improves HDR photos by digitizing each pixel’s exposure data at two different scales to gather bright and dark data when shooting in 50-megapixel mode. The abundant pixels on the sensor mean some pixel quartets are tuned for bright light and others for dimmer light.
A related feature called Smart-ISO Pro is a separate HDR technology that adapts to different scenes, employing different combinations of sensitivity settings appropriate for the different frames used to build the HDR photo.

Another new feature in the HP2 is an improved autofocus with a technology called Super QPD. It can spot either horizontal and vertical lines across 2×2 pixel groups, helping the camera lock onto details like horizons or tree trunks even when it’s dim, Samsung said.

Each HP2 pixel is 0.6 microns, or 6 millionths of a meter, wide. That’s a shade narrower than the 0.62 microns of the HP1. For comparison, a human hair is something like 75 microns across. Combined into a 2×2 array for 50-megapixel photos, the pixel width increases to 1.2 microns, and in 4×4, to 2.4 microns.

«We expect that high-resolution image sensors will become a standard feature in future flagship smartphones,» Yim said. «Because of that, we think it’s important to continue our efforts, from advanced pixel processes below 0.5 microns to pixel performance and algorithms.»

Larger sizes are better at gathering light. The Samsung pixel sizes are pretty similar to the iPhone 14 Pro’s main camera sensor, which uses 2.44 micron pixels in 12-megapixel mode and 1.22 microns in 48-megapixel mode.

When it comes to video, the HP2 has many options. It can shoot 8K video at 30 frames per second by using the sensor in its 50-megapixel mode. It can shoot 4K video at 120fps, or, if Smart-ISO is engaged, at 60fps. For 1080p video, the sensor will shoot at 480fps without autofocus and 240fps with autofocus.

Technologies

Google races to put Gemini at the center of Android before Apple’s AI reboot

Google is using its latest Android rollout to position Gemini as the AI layer across phones, Chrome, laptops and cars.

Google is using its latest Android rollout to make Gemini less of a chatbot and more of an operating layer across the phone, browser, car and laptop, just weeks before Apple is expected to show its own Gemini-powered Apple Intelligence reboot at WWDC.
Ahead of its Google I/O developer conference next week, the company previewed a number of Android updates, including AI-powered app automation, a smarter version of Chrome on Android, new tools for creators, a redesigned Android Auto experience, and a sweeping set of new security features.
Alphabet is counting on Gemini to help Google compete directly with OpenAI and Anthropic in the market for artificial intelligence models and services, while also serving as the AI backbone across its expansive portfolio of products, including Android. Meanwhile, Gemini is powering part of Apple’s new AI strategy, giving Google a role in the iPhone maker’s reset even as it races to prove its own version of personal AI on the phone is further along.
Sameer Samat, who oversees Google’s Android ecosystem, told CNBC that Google is rebuilding parts of Android around Gemini Intelligence to help users complete everyday tasks more easily.
“We’re transitioning from an operating system to an intelligence system,” he said.
As part of Tuesday’s announcements. Google said Gemini Intelligence will be able to move across apps, understand what’s on the screen and complete tasks that would normally require a user to jump between multiple services. That means Android is moving beyond the traditional assistant model, where users ask a question and get an answer, and acting more like an agent.
For instance, Google says Gemini can pull relevant information from Gmail, build shopping carts and book reservations. Samat gave the example of asking Gemini to look at the guest list for a barbecue, build a menu, add ingredients to an Instacart list and return for approval before checkout.
A big concern surrounding agentic AI involves software taking action on a user’s behalf without permissions. Samat said Gemini will come back to the user before completing a transaction, adding, “the human is always in the loop.”
Four months after announcing its Gemini deal with Google, Apple is under pressure to show a more capable version of Apple Intelligence, which has been a relative laggard on the market. Apple has long framed privacy, hardware integration and control of the user experience as its advantages.
Google’s Android push is designed to show it can bring AI deeper into the device experience while still giving users control over what Gemini can see, where it can act and when it needs confirmation.
The app automation features will roll out in waves, starting with the latest Samsung Galaxy and Google Pixel phones this summer, before expanding across more Android devices, including watches, cars, glasses and laptops later this year.
The company is also redesigning Android Auto around Gemini, turning the car into another major surface for its assistant. Android Auto is in more than 250 million cars, and Google says the new release includes its biggest maps update in a decade and Gemini-powered help with tasks like ordering dinner while driving.
Alphabet’s AI strategy has been embraced by Wall Street, which has pushed the company’s stock price up more than 140% in the past year, compared to Apple’s roughly 40% gain. Investors now want to see how Gemini can become more central to the products people use every day.
WATCH: Alphabet briefly tops Nvidia after report of $200 billion Anthropic cloud deal

Technologies

Waymo recalls 3,800 robotaxis after glitch allowed some vehicles to ‘drive into standing water’

Waymo issued a voluntary recall of about 3,800 of its robotaxis to fix software issues that could allow them to drive into flooded roadways.

Waymo is recalling about 3,800 robotaxis in the U.S. to fix software issues that could allow them to “drive onto a flooded roadway,” according to a letter on the National Highway Traffic Safety Administration’s website.
The voluntary recall is for Waymo vehicles that use the company’s fifth and sixth generation automated driving systems (or ADS), the U.S. auto safety regulator said in the letter posted Tuesday.
Waymo autonomous vehicles in Austin, Texas, were seen on camera driving onto a flooded street and stalling, requiring other drivers to navigate around them. It’s the latest example of a safety-related issue for the Alphabet-owned AV unit that’s rapidly bolstering its fleet of vehicles and entering new U.S. markets.
Waymo has drawn criticism for its vehicles failing to yield to school buses in Austin, and for the performance of its vehicles during widespread power outages in San Francisco in December, when robotaxis halted in traffic, causing gridlock.
The company said in a statement on Tuesday that it’s “identified an area of improvement regarding untraversable flooded lanes specific to higher-speed roadways,” and opted to file a “voluntary software recall” with the NHTSA.
“Waymo provides over half a million trips every week in some of the most challenging driving environments across the U.S., and safety is our primary priority,” the company said.
Waymo added that it’s working on “additional software safeguards” and has put “mitigations” in place, limiting where its robotaxis operate during extreme weather, so that they avoid “areas where flash flooding might occur” in periods of intense rain.
WATCH: Waymo launches new autonomous system in Chinese-made vehicle

Technologies

Qualcomm tumbles 13% as semiconductor stocks retreat from historic AI-fueled surge

Semiconductor equities reversed sharply after a broad AI-driven advance, with Qualcomm suffering its worst day since 2020 amid inflation concerns and rising oil prices.

Semiconductor stocks fell sharply on Tuesday, reversing course after an extensive rally that had expanded the artificial intelligence investment theme well past Nvidia and driven the industry to unprecedented levels.

Qualcomm plunged 13% and was on track for its steepest single-day decline since 2020. Intel shed 8%, while On Semiconductor and Skyworks Solutions each lost more than 6%. The iShares Semiconductor ETF, which benchmarks the overall sector, fell 5%.

The sell-off came after a key gauge of consumer prices came in above forecasts, and as conflict in Iran pushed crude oil higher—prompting investors to shift away from riskier assets.

The preceding advance had widened the AI opportunity set beyond longtime industry leader Nvidia, which for much of the past several years had largely carried the market to new peaks on its own.

Explosive appetite for central processing units, along with the graphics processing units that power large language models, has sent chipmakers to all-time highs.

Market participants are wagering that the shift from AI model training to autonomous agents will lift demand for additional AI hardware. Among the beneficiaries are memory chip producers, which are raising prices as supply remains tight.

Micron Technology slid 6%, and Sandisk cratered 8%. Sandisk’s stock has surged more than six times over since January.