Connect with us

Technologies

OpenAI boss Sam Altman spells out how and why the AI industry wants to slow down: ‘We could lose control’

OpenAI’s chief has made comments detailing how AI safety frameworks and a slowdown could work, as the industry unites behind concerns.

OpenAI chief Sam Altman has made his most detailed comments yet on how artificial intelligence safety frameworks could work, after he joined Anthropic’s Dario Amodei and Elon Musk in calling for an industry slowdown over the weekend.

Safety concerns over the technology have hit fever pitch since an Anthropic researcher quit last week, warning that those building it believed that it could “kill us all by the end of the decade” and prompting other employees at the lab and rival OpenAI to warn of catastrophic risks.

AI bosses have since shown a rare display of unity, with both Altman and Musk on Saturday backing an essay from Amodei that urged AI companies to slow how quickly they improve their most advanced models.

AI stocks were down Monday as investors digested the comments. U.S. President Donald Trump dismissed the CEOs’ warning on Sunday, saying a slowdown was not needed and would jeopardize America’s lead in AI over China.

Sam Altman sets out 2 ways AI could go ‘very badly’

“We welcome a federal framework that sets consistent safety requirements for frontier AI,” Altman said in a post on X just after midnight on Monday, adding that “no amount of American competitive pressure should justify recklessness.”

Altman warned of two ways AI progress could go “very badly,” including losing “control of the future to AI” and too much power concentrating around a single person or company.

Meanwhile, lawmakers in Washington are scrambling to address calls for safeguards.

This all comes as Anthropic and OpenAI gear up for what’s expected to be historic initial public offerings. Altman ruled out going public in 2026 in an interview with Fortune published Saturday.

Amodei’s three-step proposal

Many AI safety fears revolve around models developing the ability to improve their own performance, a technique known as recursive self-improvement, or RSI.

“Since roughly this summer, AI has been advancing drastically faster, driven primarily by AI’s growing ability to build the next generation of AI,” said Amodei in his essay. “Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all.”

Amodei proposed a three-step plan aimed at tempering the pace of development without “sacrificing commercial advantage or the United States’ lead in AI.”

The plan involves each frontier AI company giving “employee-like access” to external evaluators — which he said Anthropic was committing to now. Amodei also called for frontier AI labs to establish common safety standards, limit the rate of unchecked AI progress and attempt to coordinate efforts globally.

On Saturday, Altman said in a brief X post he agreed with Amodei that AI companies should “pace the frontier.” He added that “committing to having independent evaluators with employee-like access is a great idea, and we will do the same.”

“Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors),” Altman said in his Monday post. But, he added, “When we talk about ‘pacing,’ we do not mean ‘stopping.’ Progress has been rapid and will continue to be.”

“Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring,” he concluded.

“Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.”

International cooperation

Coordinating AI safety measures and an industry slowdown with rival AI developers in China will likely pose big challenges.

The U.S. and China remain locked in a battle for AI supremacy, with tensions ratcheting up as Chinese models have become more advanced and their global adoption grows.

Amodei said Sunday that the “toughest dilemma” about his proposal is what happens if adversarial nations choose not to do the same.

“The more long-term thing would be working together to put a speed limit on the rate of AI progress,” Amodei told CBS News’ “Sunday Morning.”

“I think that’s going to be very difficult because the incentives to pull ahead and the military advantage that you get from that are so large. And honestly, I don’t know if it’s possible, but we should try.”

The Anthropic CEO’s essay has drawn criticism in China, with the state-owned Global Times writing on Monday that “Amodei’s proposals seek to portray China’s legitimate development in AI as a threat and further fuel confrontation between China and the US in the field.”

China’s Foreign Ministry said on Monday that the CEOs’ comments were “fearmongering.”

Technologies

Amodei’s AI Slowdown Could Reshape Anthropic’s Planned IPO

As Anthropic meets with prospective investors ahead of its potentially historic market debut, CEO Dario Amodei is pushing for a slowdown in AI.

Anthropic’s path to an IPO just became significantly more complex.

While the company behind Claude is meeting with potential investors ahead of its potentially landmark debut, co-founder and CEO Dario Amodei is advocating for a strategy that appears to contradict these ambitious plans: slowing down.

Anthropic, which was valued at $965 billion earlier this year, has confidentially filed its IPO prospectus and is widely expected to list its shares as soon as next month. At the same time, concerns about the power of advanced AI models have been growing, spilling into the mainstream as more researchers warn of potential threats of human extinction.

In this context, Amodei wrote an essay over the weekend urging the AI industry to slow the pace of model development, proposing a three-step plan to temper how quickly model capabilities improve without “sacrificing commercial advantage or the United States’ lead in AI.”

This is the latest challenge facing public market investors who are trying to determine what they’re willing to pay for a piece of a five-year-old company that’s already among the most valuable in the world and could seek a $2 trillion valuation in its IPO. Although Anthropic may have to accept a hit to revenue growth, some experts say an intentional slowdown could help Anthropic position itself as a responsible actor, avoid future liability and address the public backlash towards AI that’s been building across the country.

“I don’t know that investors are necessarily going to see it as a negative,” Gil Luria, an equity analyst at D.A. Davidson, said in an interview. “Unless the companies are genuine and say, ‘OK, we’re not going to IPO, we’re not going to use any more compute, we’re not going to train any more models.’ That’s not what they’re saying.”

Continue Reading

Technologies

Iran Claims It Shot Down U.S. Advanced Drone Above Strait of Hormuz Amid Escalating Middle East Tensions

Iran says it shot down an advanced U.S. MQ‑1 drone over the Strait of Hormuz as tensions rise. The claim comes amid stalled diplomacy, renewed threats over oil control, and rising crude prices.

Iranian military announced it has destroyed an advanced American drone over the Strait of Hormuz, marking the latest exchange as Tehran and Washington trade warnings and strikes with no sign of de‑escalation. The Islamic Revolutionary Guard Corps said on Monday that its “new advanced aerospace defence system” intercepted and destroyed an advanced MQ‑1 drone in the Hormuz strait, without providing further details on the drone’s mission. The MQ‑1 is built by American defense contractor General Atomics and has historically been operated mainly by the U.S. Air Force and the CIA.

The incident follows a series of Iranian operations against U.S. unmanned naval systems in the Gulf, as the conflict, now in its seventh month, shows few signs of abating and diplomatic efforts over the strategic waterway remain stalled. On Sunday, President Donald Trump said the United States could continue its campaign against Iran and seize control of its oil, comparing the situation to the deal Washington reached with Venezuela earlier this year.

“We’ll ultimately get out (of the war), unless we decide to stay and keep the oil like Venezuela,” Trump said of the Iran conflict at the Irish Open golf championship in Ireland. He added that U.S. revenue from the Venezuela arrangement, which gave Washington access to roughly a fifth of Venezuela’s oil reserves, has “paid for the war many times.”

Under the August agreement, Venezuela ceded majority U.S. control of more than 65 billion barrels of oil reserves — more than double America’s own reserves — in exchange for $209 billion for Venezuela’s state treasury. Secretary of State Marco Rubio said the deal would also bring close to $100 billion in private investment to reinvigorate the Venezuelan economy.

On Sunday, Trump said he expects the seven‑month Iran war to end this year, possibly after the November midterm elections, and insisted that gasoline prices would “drop like a rock” once it does. He said he would only make the “right deal,” adding that Tehran has been “calling constantly” for peace talks, a claim Iran has previously dismissed.

Stalled Hormuz talks

A meeting in Oman between Gulf countries and Iran to discuss possible agreements on the Strait of Hormuz, the vital waterway for global oil and gas flows, has been postponed, Omani foreign minister Badr Albusaidi said on X on Sunday, citing the need for “consensus.” Officials from Iran and Gulf nations had been expected to meet on Monday and sign an agreement establishing an Iran‑Oman shipping route through the Strait of Hormuz, though no direct talks between the U.S. and Iran were ongoing.

The Strait of Hormuz has been subjected to an Iranian and later U.S. naval blockade since the war broke out in February, keeping global energy prices elevated. A June accord between Washington and Tehran faltered over disagreements about the artery, and a recent offensive by Yemen’s Houthi rebels has given the Tehran‑aligned group leverage over a second critical waterway, the Bab el‑Mandeb.

Ships deemed non‑compliant are regularly targeted by Iranian strikes, while the U.S. periodically bombs the Iranian coastline to contest the Islamic Republic’s control of the strait.

Oil prices rose past $100 a barrel again for the first time since May and climbed further on Monday after Saudi Arabia shut a key East‑West energy pipeline following damage from Iraqi drones. U.S. West Texas Intermediate futures were up 2.3% to $102.39 per barrel. Brent crude, the international benchmark, traded 2.4% higher to $107.11 a barrel.

Continue Reading

Technologies

What Amodei’s AI slowdown could mean for Anthropic’s imminent IPO

As Anthropic meets with prospective investors ahead of its potentially historic market debut, CEO Dario Amodei is pushing for a slowdown in AI.

Anthropic’s road to an IPO just got a lot bumpier.

While the Claude creator meets with prospective investors ahead of its potentially historic debut, co-founder and CEO Dario Amodei is pushing a concept that would seem to contradict those ambitious efforts: a slowdown.

Anthropic, valued at $965 billion earlier this year, confidentially filed its IPO prospectus in June, and has been widely expected to list its shares as soon as next month. Meanwhile, concerns about the power of advanced AI models has been intensifying for weeks, spilling into the mainstream as more researchers warn of potential threats of human extinction.

With that backdrop, Amodei wrote an essay over the weekend urging the AI industry to slow the pace of model development, proposing a three-step plan to temper how quickly model capabilities improve without “sacrificing commercial advantage or the United States’ lead in AI.”

It’s the latest challenge facing public market investors who are trying to determine what they’re willing to pay for a piece of a five-year-old company that’s already among the most valuable in the world and could seek a $2 trillion valuation in its IPO. Though Anthropic may have to accept a hit to revenue growth, some experts say an intentional slowdown could help Anthropic frame itself as a responsible actor, avoid future liability and address the public backlash towards AI that’s been brewing across the country.

“I don’t know that investors are necessarily going to see it as a negative,” Gil Luria, an equity analyst at D.A. Davidson, said in an interview. “Unless the companies are genuine and say, ‘OK, we’re not going to IPO, we’re not going to use any more compute, we’re not going to train any more models.’ That’s not what they’re saying.”

Anthropic has picked the Nasdaq as the exchange for its potential IPO, CNBC confirmed after Business Insider first reported the selection.

Amodei on Saturday proposed that model companies open up to third-party evaluators, frontier companies establish “common safety standards,” and that democratic countries coordinate with authoritarian governments “to the extent this is possible.”

His essay came after several industry researchers issued stern warnings last week about the technology’s growing potential to cause catastrophic harms.

President Donald Trump slammed Amodei in a post on Truth Social on Monday, writing that the only “control or ’guardrails’ that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades!”

“The Trump Administration has stopped AI ‘people’ from doing bad, or potentially bad, ‘things,” like Dario (Anthropic!), who is now pretending to be a ‘perfect little angel’ – and we will continue to do so!,” Trump wrote. “We already have tremendous CRIMINAL and REGULATORY power over these companies!”

OpenAI CEO Sam Altman expressed support for Amodei’s proposal, as did Elon Musk, CEO of SpaceX, which owns Grok creator xAI. SpaceX went public in June in the biggest IPO on record and is now valued at $2 trillion. OpenAI has confidentially filed its IPO prospectus, but has been under fire in recent months after its models escaped containment, accessed the open internet and breached open-source developer platform Hugging Face.

“Right now would be an ill-advised moment to go public,” Altman said in an interview with Fortune, reiterating that OpenAI won’t aim for an IPO until next year. Finance chief Sarah Friar told employees during an all-hands meeting last month that the AI lab “will be a public company in 2027.”

Lise Buyer, partner at IPO advisory firm Class V Group, said she doesn’t see the recent “we might obliterate you all” fears having an impact on IPO timing, but it could alter valuations, she said.

“The bet here is on the long term — now with tempering thoughts about control of the technology,” Buyer said in an email. “The dramatic growth and possibilities of these companies, now more publicly coupled with the potential very serious concerns and risks, will likely persist whether the IPO happens in Q4 or next year or whenever.”

Anthropic and OpenAI declined to comment for this story.

â€ČDon’t see why growth would slow’

Anthropic hit $65 billion in annualized revenue in July, about a sevenfold increase from the prior year, as CNBC previously reported. The company has told some shareholders that it will generate an operating profit for a second straight quarter in the current period, according to two sources familiar who asked not to be named because the details are confidential. The Financial Times earlier reported the operating profit on Sunday.

Matt Murphy, a partner at Menlo Ventures and an Anthropic investor, called the growth rate “off the charts,” and said a public listing would bring more transparency around the business.

“Don’t see why growth would slow or any other reason to wait,” Murphy told CNBC.

That transparency could also help improve what has been dismal public sentiment around the technology.

More than half of Americans say they’re more concerned than excited about the growing use of AI in daily life, up from 37% in 2021, according to a recent report from the Pew Research Center. And confidence in AI executives is even worse, according to a CNBC Generation Lab survey of 18- to 34-year-olds. More than 75% of respondents said they don’t trust Amodei to act responsibly, while around 70% expressed those views about Altman.

“One could argue that sooner is better than later for a public offering as the accountability that comes with being a public company might be of a great interest to many,” Class V Group’s Buyer said.

Altimeter Capital CEO Brad Gerstner, whose firm is an investor in Anthropic and OpenAI, said in a post on X on Saturday that bringing more “transparency, scrutiny, accountability” and participation to AI companies is “crucial.” He said Anthropic will likely forge ahead with its IPO.

“The market knows how to price risk – see SpaceX,” Gerstner wrote. “There is huge appetite to invest in the AI leaders.”

Gerstner’s post came a day after he blasted public remarks from industry researchers, calling them “hyperbolic scare tactics” that are “hiding behind a political agenda,” in an interview with CNBC.

There are plenty of skeptics when it comes to Amodei’s latest positioning. One argument is that Anthropic benefits from stricter standards because it currently has the most advanced models and makes money from selling services, like Claude Code, that are powered by those models.

“That could actually favor Anthropic and OpenAI if smaller competitors cannot afford the rigorous safety, evaluation and security investments required for frontier-level models,” Arun Chandrasekaran, an analyst at Gartner, told CNBC in an email.

D.A. Davidson’s Luria agrees and said he thinks Anthropic and OpenAI are engaging in “monopolistic behavior.” OpenAI has reportedly asked members of Congress for guidance about whether a coordinated, industrywide slowdown would violate antitrust law, according to Wired.

“I’m highly suspicious of what Anthropic and OpenAI are doing,” Luria said. “It feels more and more like a ladder pull.”

What about the rest of tech?

Tech investors have other reasons to worry about the pace of development at OpenAI and Anthropic, because those companies are responsible for an outsized amount of AI infrastructure spending.

Anthropic has inked a flurry of multibillion-dollar compute deals this year, including with Nscale, Advanced Micro Devices, SpaceX, and Google. OpenAI told investors in February that it’s targeting roughly $600 billion in total compute spend by 2030. Both companies are heavy users of Nvidia’s graphics processing units.

“I would want to understand how the mix shifts between frontier training, post-training and inference as safety controls are integrated,” said Lo Toney, managing partner at Plexo Capital, and an Anthropic investor.

PitchBook analyst Harrison Rolfes is more concerned about reduced growth. He said valuations for model companies likely deserve a discount now, largely because it’s hard for investors to trust that they can safely commercialize their technology.

“Is the first thing that you want to do as a public company go handle a bunch of security issues and vulnerability issues?” Rolfes said. “No, you probably want to focus on expanding into all the markets that you promised all your investors.”

Gene Munster, managing partner at Deepwater Asset Management, told CNBC that any sort of perceived slowdown will be a negative because the market is “underwriting exponential uninterrupted improvements to the models.”

Still, Munster predicted that “nothing will change and the AI leapfrog game will continue.”

“AI’s long-term opportunity is too big for them to slow down,” Munster said. “I believe the comments were motivated to reduce the regulatory pressure.”

WATCH: Seems like Anthropic will beat OpenAI to IPO, says FirstMark’s Rick Heitzmann

Continue Reading

Trending

Copyright © Verum World Media