Technologies
How CNET tests phones
What goes into a CNET smartphone review
Phones are much more than communication devices; they’re our gateway to the internet. They’ve become the center of our daily lives, housing our personal information, work essentials, personal memories and enabling us to reflect our personalities online. That’s why CNET conducts rigorous tests to help you find the right phone for your budget and needs.
When reviewing phones, we take a variety of factors into account such as camera quality, battery life, design, software and longevity. Every phone is different, but our testing allows us to answer the same question in each review: Is this phone worth buying? We evaluate phones based on the quality of their hardware and software, whether they introduce any meaningful new innovations and whether they’re the right price.
We replace our personal phone with the test unit during the review period so that we can get an accurate impression of what it’s like to rely on the device for daily tasks. In addition to this anecdotal usage, we also conduct specific side-by-side tests against other phones as part of the evaluation process.
We generally test phones against their immediate predecessor, competing phones from other companies or another phone within the same product line (for instance, iPhone 14 versus iPhone 14 Pro). We focus on whichever comparisons are most useful for helping our readers navigate the buying decision, and that may vary depending on the phone. Whenever possible, we work all three types of comparisons into a review.
Some of these methodologies are relatively new to CNET’s testing procedures, so you may not see them in all of our reviews from 2022. We’re in the process of updating our current reviews with these tests and plan to implement them fully in 2023.
Below is a general overview of what goes into a CNET smartphone review.
Testing smartphone cameras
The camera is the biggest area where companies like Apple, Samsung, Google and OnePlus typically make improvements to new models each year, and our reviews put phone maker’s claims to the test. We take photos in a variety of circumstances and lighting conditions, including bright outdoor areas, dim indoor settings and mixed lighting.
We capture a variety of subjects (objects, pets and people) to assess boldness, sharpness, skintones and color accuracy. We test all of the phone’s main lenses (wide, telephoto and ultrawide), front-facing cameras as well as different shooting styles, like portrait mode and night mode. Our reviews also cover useful editing features or shooting modes that are specific to the device, such as the Google Pixel 7’s Face Unblur or the iPhone’s Cinematic Mode.
Part of these tests include side-by-side photo comparisons between the phone we’re reviewing and previous phones we’ve tested. We evaluate a phone’s cameras on their consistency as well as how they stack up against the competition. All photos are straight out of camera and accessed without any edits, unless specifically noted. Beyond the initial impressions we get from viewing these photos on a phone’s screen, we also upload them to a computer and view them alongside one another on a monitor. This reduces any bias that may come from the different screens on each phone. It also makes it easier to view discrepancies in clarity and color between each photo.
We also capture video with the review phone and judge it on its image and audio quality. Just because a phone can capture 6K or 8K video doesn’t mean it’s good. Unlike the computational photography algorithms that Google, Apple, Samsung and others apply to photos, videos remain relatively less processed, making it easier to critique a camera’s strengths and flaws.
Testing smartphone performance
The performance section of our reviews examines how responsive phones are in everyday use, how well they juggle multiple tasks and how they fare during benchmark tests.
We do this by observing how quickly phones can open apps and launch the camera. We also note whether the phone has an adaptive refresh rate setting and how this improves performance if at all (for example, whether this makes animations and scrolling feel smoother). We also look for signs of lag when running multiple apps (such as using a social media app or playing a game while on a video call), or playing an online multiplayer game with the highest graphics settings.
In addition to these everyday tasks, we also run a series of benchmarks designed to test a phone’s computing power and graphics performance. These tests include Geekbench 5 for general CPU performance and 3DMark Wild Life Extreme for graphics. We also run the same tests on other phones that we’re comparing our test device to.
Testing smartphone battery life
We test battery life in three ways: through an anecdotal stress test, a video streaming test and by observing battery life after everyday use. As noted earlier, these tests are relatively new and we’re still in the process of adding them to our 2022 reviews.
The anecdotal stress test measures how much the battery drains after 45 minutes of general usage. We do a little bit of everything during this test to mimic authentic everyday experiences. That includes streaming video, using social media apps, playing a game, making a video call and other miscellaneous tasks like checking email. After this 45 minutes of mixed usage, we mark down the percentage of battery drain. To keep the test consistent between phones, we perform each of those tasks for roughly 10 minutes. We also keep the screen brightness set to 50%, turn off the always-on display and keep the high refresh rate setting on (if there is one).
The streaming test monitors how much the battery drains over a three-hour period while viewing a video on YouTube. We use the same video each time for consistency and set the screen brightness to 100%. We also disable settings that automatically dim or brighten the screen, connect to Wi-Fi and turn on the adaptive or high refresh rate setting if applicable. We take battery percentages at the one-hour, two-hour and three-hour marks.
Since we use test phones as our regular devices, we also discuss how long the battery has lasted in everyday use based on our experience. Often, our practical experience with a phone’s battery life can give us the most accurate prediction of what others might expect if they bought the same phone.
Testing smartphone design, software and display
Our smartphone reviews also encompass other areas like design, software and display quality. Design can be subjective, but we generally look for factors such as durability (water and dust resistance ratings), how easy the phone is to operate with one hand, the build quality and whether the design is unique or interesting in any way. For display quality, we’ll mention factors like brightness, how easy it is to see in sunlight and sharpness and color.
Software is another key part of CNET’s smartphone reviews. We mention any new or noteworthy features and how long the phone will support new versions of Android (or iOS respectively) and security updates.
Our written review tells you everything we feel and experienced, but we also give each phone overall score and star rating to provide a different context. A $450 phone might lack all the features that a $1,000 phone has, but its value might mean it gets a higher score. We also update these ratings based on a variety of factors, including software changes and quality control issues.
Reviews will always vary depending on the device, but these are the core tenets that make up a CNET smartphone evaluation. Determining a phone’s overall value is our guiding principle in every smartphone review. Our reviews shed light on whether a new phone lives up to its expectations, who the phone is for and whether it delivers on its promises for the price. We are always evaluating our own testing methodologies and looking for ways to improve, so expect to see more updates in the future.
Technologies
NBA commissioner Adam Silver says league could introduce âsmart ballâ technology as soon as next year
Commissioner Adam Silver says the NBA could begin using a new “smart ball” in games as soon as next year, potentially transforming how officials make calls.
NBA Commissioner Adam Silver says the league could begin using a new âsmart ballâ in games as soon as 2027, potentially transforming how officials make calls on the basketball court.
In an interview with CNBCâs Contessa Brewer, Silver revealed that the NBA is working with official basketball manufacturer Wilson to develop a ball embedded with a tiny microchip Bluetooth sensor that can track movement, spin and changes in trajectory.
âWeâre experimenting with putting a small chip in the ball that weighs roughly a gram,â Silver said.
The technology has already been tested in the NBAâs G League, Summer League, and some preseason games, where players used basketballs both with and without the chip. Silver said players have been pleased with the results.
âNobody could tell the difference. So thatâs a good sign,â he said.
The chip weighs just one gram, compared with the roughly 620-gram or 1.4 pound basketball. Silver said the league wanted to ensure that even the most experienced players wouldnât notice a change in how the ball feels or bounces.
One of the most immediate applications could be officiating.
Silver said the technology could help referees determine whether a player touched the ball before it went out of bounds by detecting subtle changes in its spin. It could also help identify whether a shotâs trajectory was altered.
âI think you could see as soon as next year us using it for officiating in our games,â Silver said.
Beyond officiating, Silver sees a significant opportunity to bring the technology to consumers, allowing basketball players of all ages to analyze and evaluate their shooting mechanics.
For example, a player taking hundreds of shots could use data collected by the chip to understand which shooting angles and ball rotations are most likely to result in a basket.
âYouâll then see the graph, and youâll see for which the angle of the shots that went in, theyâre more likely to go in,â Silver said.
While the officiating application could arrive as soon as next year, Silver said a consumer version may take longer.
âI think the consumers version [of the smart ball] is a few years away, but itâs a really exciting opportunity.â
NBA playersâ union raises concerns over wearables
The league is also exploring the use of wearable technology during games, but negotiations with the National Basketball Players Association have yet to produce an agreement.
The NBA says officials experimented with wrist wearables in select preseason and summer league games this year in a âsuccessful pilot program,â but it will not extend into the season. The technology allowed the referees to communicate with the replay center about reviews, scoring changes and clock malfunctions.
Silver said players routinely use wearable devices off the court to monitor everything from sleep to physical performance, but concerns remain over how data collected during games could be used by teams.
âI think we have to come to some agreement on exactly how the information is used. But it seems everybody wants that information,â Silver said.
The biggest sticking point is whether that information could affect contract negotiations, Silver said.
âIf you could see a player was slowing down or something like that, theyâre worried that that could get used in bargaining, and I get that,â he said.
Silver acknowledged those concerns and said the league needs to reach an agreement with the playersâ union on how the information would be used.
Still, he suggested that allowing wearables during games is a logical next step as athletes increasingly rely on technology to monitor their performance.
âI think the players are in a position right now where theyâre essentially wearing wearables 22 hours a day, and the only time theyâre not wearing them is when theyâre playing in the game,â Silver said. âSo that canât make sense.â
âWeâll work something out with them,â he added.
Technologies
AIâs quiet safety gatekeepers are stepping into the spotlight
The intensifying AI safety debate is bringing a small group of third-party evaluators into the center of a multitrillion-dollar industry.
Two months ago, independent evaluators occupied a relatively sleepy corner of the multitrillion-dollar artificial intelligence industry. Now theyâre being asked to come to its rescue.
While Anthropic and OpenAI are the heart of a fierce debate over whether they can safeguard their advanced models and grow their businesses simultaneously, the companies are seeking support from a handful of small third-party groups like Model Evaluation and Threat Research (METR), Apollo Research and Transluce.
The evaluators, which mostly operate as nonprofits, are still finding their footing in an industry where capital is flowing at historic levels and new models are rolling out faster than ever. Their primary role has been to assess AI model capabilities and risks, and to call attention to instances where the technology behaves badly.
In the absence of a federal push for regulations, evaluators have taken on outsized importance. Anthropic CEO Dario Amodei pledged to embed independent evaluators in his company last month â a move that OpenAI CEO Sam Altman quickly endorsed.
President Donald Trump supported the idea, as did most of the largest U.S. tech companies. But left unanswered are questions about how those third parties should be funded, what level of access they will have and what the reporting structure will ultimately look like.
âTo a degree, the problem, as always, is money,â Suresh Venkatasubramanian, a computer science professor at Brown University, told CNBC in an interview. âWho is paying for these companies to do their work? How are they going to support them? You need an ecosystem, you need a viable business model for this.â
Right now, Anthropic, OpenAI and the infrastructure partners that are profiting from the AI boom are writing the rules. Critics say thatâs like asking the biggest banks to protect us from a financial crisis or allowing pharmaceutical companies to put drugs on the market without regulatory clearance.
President Trump recently lauded AI executives for their âtremendous self-policing,â and signaled that he intends to leave companies to their own devices, unwilling to impede the growth of the industry thatâs driving the economy and stock market. Trump encouraged AI companies to âpartner with an independent external auditor or evaluatorâ as part of a voluntary accord he presented in late September.
Itâs a conversation that Amodei kicked off In his viral essay last month, when he called for a âslower paceâ in advanced model development after researchers left his company and voiced their concerns about the existential threats the technology poses.
As the AI labs move to put evaluators in place, friction is already starting to emerge.
OpenAI fired three employees last week for âviolating our policies on accessing and handling sensitive company information,â according to a spokesperson. Two of those employees, Mikita Balesni and Tomek Korbak, said they believe they were dismissed because of how they communicated with third-party evaluators.
âMy former colleagues are telling me they are confused about what to believe,â Balesni wrote in a post on X on Thursday. âThey also are afraid to speak, and worry their personal phones will be searched for messages to us and third parties. I worry the pervading fear to speak up and engage with third parties will mean OpenAI will cut corners on safety behind closed doors.â
OpenAI disputed that characterization and said in a post on Friday that itâs âactively finalizing contracts with third-party safety assessors and will announce details in the coming weeks.â
âWe are committed to embedding external assessors and continue to make close collaboration with independent safety organizations a core part of our safety work,â OpenAI wrote.
An OpenAI spokesperson said in an emailed statement that its upcoming work with evaluators âbuilds on existing collaboration with independent safety organizations,â including METR and Redwood Research.
Anthropic didnât respond to CNBCâs request for comment.
âIâve never seen an issue move so fastâ
The AI evaluator ecosystem consists mostly of small organizations, including METR and Apollo Research, and larger accounting and auditing firms like Accenture.
AI labs have been working with evaluators in limited capacities, but Andrew Freedman, CEO of policy nonprofit Fathom, said the field is quickly maturing.
âIâve worked in politics and policy for the last 20 years of my life, and Iâve never seen an issue move so fast on so many different political spectrums,â Freedman told CNBC in an interview. He said he expects an âinflux of capitalâ to flow into the ecosystem.
Rayan Krishnan, CEO of independent evaluator Vals AI, said his for-profit startup, which builds benchmarks to measure how AI models perform on industry-specific tasks, has grown from eight employees to roughly 30 this year, and in August announced a $40 million funding round.
METR, a nonprofit, announced in August that it had raised commitments of around $71 million over the last six months. Thatâs up from total 2024 contributions of $13.6 million, according to the groupâs most recent filing with the Internal Revenue Service.
By late that month, METRâs profile had risen further. OpenAI enlisted two of its employees and a contractor to put together a postmortem report detailing how the companyâs models escaped containment, accessed the open internet and breached open-source developer platform Hugging Face. METR said it did not accept payment from OpenAI for the assessment.
Kevin Werbach, faculty director of the Wharton Accountable AI Lab at the University of Pennsylvania, said the ecosystem is ânot robust enough right now.â METR, for example, employs fewer than 50 full-time staffers, according to its website.
The power imbalance between the small evaluators and the leading labs that have raised tens of billions of dollars and employ thousands of people raises questions surrounding potential conflicts.
âIf you want true third-party evaluation, you need true independence financially and otherwise,â said Venkatasubramanian. âItâs not just a matter of not getting paid, itâs a matter of, will there be consequences if I am an auditor and I put out a report that looks unfavorable to this company? Is my business going to dry up?â
Anthropic acknowledged the complexity in a blog post last month, as it announced it will embed employees from Faculty, Accentureâs specialist AI business, to test safeguards and assess whether models will behave in line with human values. Anthropic said that âgiven the importance and urgency of this work,â it will fund Accentureâs contributions directly.
âThere are, as yet, no standards for what information embedded evaluators should have access to, or how they should report what they find. There is also no settled system for funding independent evaluation,â Anthropic said. âLong-term, we think funding should come from pooled or government sources.â
Anthropic said itâs in discussions with METR and other nonprofit evaluators that are planning to use their own funding to pilot âelementsâ of embedded evaluation.
Will the government step in?
In June of last year, Fathom introduced a marketplace framework for Independent Verification Organizations, or IVOs. These groups would be licensed by the government and authorized to test whether AI companies are meeting various safety criteria.
Freedman, the groupâs CEO, said government oversight is key because otherwise third-party evaluators can become beholden to the large AI labs for revenue, incentivizing them to âstart rubber stamping stuffâ to maintain favor.
Some lawmakers are on board.
IVOs are a key provision of the âłFrontier Risk Oversight, National Transparency, Independent Evaluation, and Reportingâ (FRONTIER) Act, which Reps. Lori Trahan, D-Mass., and Jay Obernolte, R-Calif., introduced in July. Fathom helped draft language and provided technical expertise for the bill, Freedman said.
OpenAI global affairs chief Chris Lehane told reporters in September that he sat down with one of the billâs sponsors on Capitol Hill to express support for the IVO provision.
âIt was important for them to hear that and hear it from us, and we wanted to be really clear about that,â Lehane said, according to reports.
Meanwhile, lawmakers in California, Connecticut and Virginia have taken steps to implement IVOs, and states like Massachusetts are weighing independent safety evaluations more broadly.
California Governor Gavin Newsom recently signed two bills involving IVOs, one establishing a âfirst-in-the-nation framework,â and the other creating a state registry for AI auditors. Anthropic threw its support behind both bills in August, and OpenAI formally endorsed them last month, the same day Newsom signed them into law.
Lehane wrote in a blog post at the time that âwe prefer independent technical assessments to be required at the federal level,â but in the absence of federal action, âCalifornia can help establish the rules of the road.â
Freedman said he thinks it will be âreally difficultâ for companies like OpenAI and Anthropic to work out how to engage with independent evaluators on their own. However, with the governmentâs role unclear, âitâs a muscle worth developing in the interim,â he said.
For now, the closest thing the industry has to a set of standards is what Trump called a âmorally bindingâ agreement at a luncheon he hosted for tech leaders at the White House late last month.
The one-page accord says that âevery company is responsible for developing its own technology safely and in a way that builds trust with customers and the public.â It also encourages signees to work with an âindependent external auditor or evaluator to carry out independent assessments.â
The document was signed by top execs at Anthropic, Google, Meta, OpenAI, SpaceX and Nvidia, a rare show of solidarity between leaders who have shared conflicting views on addressing AIâs risks. The executives still have to chart their own paths forward.
âIt was a performance of an attempt to show action when in fact no action actually happened,â Venkatasubramanian said. âThe things that they promise to do are things they should have been doing already, and, in fact, have claimed that they were doing in the past.â
Amodei, in his September essay, said Anthropic will equip evaluators with desks, access badges, company laptops, and permissions that are âmostly comparableâ with internal risk assessment teams. Additionally, evaluators will be supported with contracts that give them âthe right to publish key findings,â with Anthropic reserving âthe narrow abilityâ to redact certain security-sensitive or confidential information.
âThis is an unusual step for a company, but we think it is important to prove out the concept of embedded external reviewers,â Amodei wrote.
OpenAI published its own proposal days later, and said evaluators should work on âscoped and mutually agreed upon claims for assessment,â clearly explain their methodology and standards, demonstrate relevant technical expertise and disclose conflicts of interest.
The AI Evaluator Forum, which includes METR, the AI Verification and Evaluation Research Institute (AVERI), and other groups, published a public letter last month titled, âMinimum Conditions for Embedding Evaluators.â
The letter said evaluators should be transparent, shielded from retaliation and granted access equivalent to AI companiesâ âown highly privileged employees.â
âEmbedded evaluations cannot address all oversight needs and should be treated as a complement to, rather than a replacement for, broader efforts by frontier AI companies to expand external oversight,â the letter said.
Freedman said heâs seen a shift in posturing out of OpenAI and Anthropic in recent months, largely because theyâve realized they wonât be able to roll out their advanced systems without the publicâs trust.
âI donât think you need to trust that theyâve suddenly turned altruistic or that thereâs anything but corporations acting like corporations,â Freedman said.
That underscores perhaps the central problem, Werbach said. OpenAI and Anthropic are, first and foremost, competing with each other as they march toward the public markets and seek trillion-dollar-plus valuations.
âThere is a tremendous amount of personal distrust between those two companies,â Werbach said. âEven though thereâs also tremendous agreement about the need for this kind of evaluation to happen.â
WATCH: Bradley Tusk on Anthropic IPO: Why add public market pressure if safety is your top priority?
Technologies
Trump says he is ‘going to look at’ joining Saudi Arabia in the fight against Iran-backed Houthis after deadly airport strike
U.S. military involvement in the fight against the Houthis would stretch resources in the Middle East already committed to fighting Iran, analysts said.
President Donald Trump said he is considering joining Saudi Arabia in its retaliation against Tehran-backed Houthis in Yemen after a deadly attack on Riyadhâs main airport, a move that could draw the U.S. further into a second front in the Iran war.
âWe may. Weâre going to look at it,â Trump told reporters outside the White House on Saturday when asked if the U.S. would back Saudi Arabian strikes. âWe just found out about the recent attack. So, weâll make a decision. We move very quickly.â
Two Saudi Arabian government officials told MS NOW that the kingdom is requesting âurgent defense supportâ from the U.S. following the attacks.
The officials, including a senior member of the Ministry of Foreign Affairs, did not want to be identified because of the matterâs sensitivity. They added that the U.S. needs to intervene âas soon as possibleâ to help the Saudi-led coalition in Yemen fight the Houthis.
The White House did not immediately respond to a CNBC request for comment.
The Saudi General Authority of Civil Aviation said the attack on King Khalid International Airport in Riyadh killed 12 people and injured 309 others, the countryâs official Saudi Gazette media outlet reported.
Colonel Turki Al-Maliki, the spokesman for the Saudi-led Coalition to Support Legitimacy in Yemen, which has been leading the fight against the Houthis, described the attack as a âwar crime.â
âTherefore, the Joint Forces Command of the Coalition will respond decisively to this terrorist attack in accordance with the Customary International Humanitarian Law,â Al-Maliki said in a post on X.
It was the second deadly assault on Riyadhâs airport in less than a week.
Three Saudi nationals, including a pilot, were killed in attacks on the facility by Iran-backed Houthi militants on Thursday.
Following Saturdayâs attack, the Houthis renewed their warning against using Saudi airports.
âWe renew our warning to all airlines, experts, employees, workers and travellers against using Saudi airports and airspace, as they are vulnerable to attack and have become a theatre of operations for our forces, with the exception of the airports in (the holy cities of) Mecca and Medina,â the Houthis said in a post on X.
Saudi Arabia, a key U.S. ally in the Middle East, intervened in Yemenâs civil war between the Houthis and its internationally recognized government after the group seized the Yemeni capital Sanaa in 2014.
Last month, the Trump administration approved the potential $24.3 billion sale of nearly 50 F-35 warplanes to Saudi Arabia in what was seen as a major boost for the kingdom as it faces intensifying attacks from the Houthis. The sale is under congressional review.
International energy conference still on
The Saudi energy ministry said a long-planned international energy conference will still take place in Riyadh on Sunday, Reuters reported.
The five-day WPC Energy Congress is taking place at a convention center near King Khalid airport. State television told Reuters that more than 70 ministers, 300 company executives and representatives of more than 25 international energy organizations have confirmed their attendance, though it was not clear whether the participants would attend in person or virtually.
Reuters said a ministerial meeting of the International Energy Forum is also set to take place, with its plenary session to be held behind closed doors.
Energy choke points
In addition to attacks on civil aviation, the Houthis have also been trying to choke off oil tanker traffic through the Bab el Mandeb strait, a key entry point to the Red Sea, as Iran has effectively done in the Strait of Hormuz to the north of the Arabian Peninsula.
Earlier this month, Yemeni government forces said they reclaimed the strategic port city of Mokha from the Houthis.
Energy prices have soared since the start of the Iran war, which began with U.S. and Israeli airstrikes on Iranian targets on Feb. 28, putting pressure on consumers globally.
The surge in domestic fuel prices has been a key issue for voters ahead of next monthâs U.S. midterm elections.
But that support would be expensive militarily.
âPotential U.S. involvement in the Saudi-Yemeni government air campaign to degrade Houthi ballistic missile capabilities would mark the first direct U.S. military action against the group since the conclusion of Operation Rough Rider in May 2025,â according to the Critical Threats Project, part of the American Enterprise Institute think tank.
The offensive aimed to suppress the Houthisâ capabilities, but recent attacks show the group has regrouped.
âAfter seven months of war, there are questions about the U.S. capacity to wage a sustained campaign against the Houthis, return to combat against Iran if necessary, and prepare for contingencies in other parts of the world, notably East Asia,â Steven Cook, an expert on Arab and Turkish politics at the Council on Foreign Relations think tank, wrote last month.
Meanwhile, the United Kingdomâs defense secretary said his government is also examining how to support Saudi Arabia.
âIâve spoken to my Saudi counterpart [Khalid bin Salman] on a number of occasions in recent weeks to look at what more we can do to support Saudi Arabia, and Iâm afraid last night explains precisely why we are providing that support,â Wes Streeting said in an interview on BBC television on Sunday.
Streeting said the U.K. is not getting involved in offensive operations âat this stage.â
âWeâve always been clear that there isnât a military solution to this conflict,â Streeting added.
-
Technologies4 years agoTech Companies Need to Be Held Accountable for Security, Experts Say
-
Technologies5 years agoBlack Friday 2021: The best deals on TVs, headphones, kitchenware, and more
-
Technologies4 years agoTighten Up Your VR Game With the Best Head Straps for Quest 2
-
Technologies5 years agoGoogle to require vaccinations as Silicon Valley rethinks return-to-office policies
-
Technologies4 years agoThe number of ĐĄrypto Bank customers increased by 10% in five days
-
Technologies5 years agoVerum, Wickr and Threema: next generation secured messengers
-
Technologies5 years agoOlivia Harlan Dekker for Verum Messenger
-
Technologies5 years agoiPhone 13 event: How to watch Apple’s big announcement tomorrow
