Technologies
God of War: Ragnarok’s Emotional Ending Explained
Kratos and Atreus’ second adventure ends in spectacular fashion. Heavy God of War: Ragnarok spoilers inside.
It’s only November, but it’s already Christmas time for PlayStation owners. God of War: Ragnarok, the most anticipated PlayStation exclusive of the year, is finally here. The game is highly acclaimed, with a score of 94 on Metacritic, having received glowing reviews from publications such as ours.
God of War: Ragnarok is lauded for a lot, but its touching and thoughtful story perhaps most of all. “Touching” and “thoughtful” may be surprising descriptors for a game called “God of War,” but anyone who played Ragnarok’s 2018 predecessor likely would expect as much. As the title suggests, God of War: Ragnarok is about a cataclysmic war known in Norse mythology as Ragnarok.
At its core, however, it’s much more about the relationship between a father and his son. That father just happens to be an unstoppable killing machine. It goes without saying, but I’ll say it anyway: Massive God of War: Ragnarok spoilers below.
The short version of God of War: Ragnarok’s ending
After spending much of God of War: Ragnarok fiercely rejecting the idea of war, Kratos is eventually pulled into participating in Ragnarok — the great war against Asgard. Before that happens, it’s revealed that Tyr, the Norse god of war who’s been staying at Kratos & Co’s headquarters, has actually been Odin all along. Odin used his godly powers to disguise himself as Tyr, and spent the whole game spying on Kratos, Atreus and Freya.
Odin makes his grand revelation by stabbing and killing Brok. That turns Sindri, normally gregarious and deferential, into an angry Dwarf, deeply resentful of Kratos, Atreus and their role in setting up Brok’s death. Sindri helps them out at Ragnarok, but only because he wants revenge on Odin. He uses a tool that gives the gang a way to penetrate through the wall that surrounds Asgard.
Inside, Kratos battles and defeats Thor. Just as Thor begins to repent for his sins and heed Kratos’ plea to be a better god, Odin appears and kills Thor. Kratos, Freya and Atreus then battle and defeat Odin. Atreus uses Giant magic to trap Odin’s spirit in a marble, then Sindri appears, snatches the marble and smashes it to bits with a hammer. Like I said, angry Dwarf.
The gang manages to escape Asgard thanks to Angrboda, a Giant who Atreus meets early in the game. After the battle, Angrboda tells Atreus she knows he’s had Giant visions, and that she needs to tell Kratos. He does so, informing his father that there are other Giants out there, and that he alone needs to find them. In the moment of Ragnarok, Kratos embraces his son and tells him he’s ready for his own adventure.
Atreus says goodbye, and Kratos sees on a shrine revealed to him by Agrboda that the Giants long ago prophesized him as the hero of Ragnarok.
Santa Monica Studio, God of War’s developer, has said Ragnarok is the end, and that God of War won’t be spun into another trilogy. But the way the game ended absolutely opens up the possibility of a follow-up that focuses on Atreus — possibly with Sindri as a villain. Dwarf magic is established as immensely powerful in God of War: Ragnarok, and Sindri’s obvious hatred of Kratos and Atreus is one of the conspicuous threads left untied by Ragnarok’s end.
That’s the short version of God of War: Ragnarok’s ending. Read on for a more comprehensive look at how God of War: Ragnarok played out.
The lead up to Ragnarok
To understand God of War: Ragnarok’s story trajectory, you need to understand a little about how its story is told. Unlike the 2018 God of War, in which Atreus is by Kratos’ side for almost all of the adventure, the two go their separate ways for a lot of Ragnarok’s story.
About halfway through the game, Atreus hatches a plan. Odin at the beginning of God of War: Ragnarok invites Atreus to Asgard. What if Atreus goes to Asgard, pretends to switch sides, buddies up with Odin and learns his Ragnarok plans?
Atreus gets into Asgard by having Odin’s ravens transport him there. After climbing the giant wall that surrounds Asgard’s city, Atreus learns that Odin is motivated by a tear into another dimension. “The rift, possibly the birthplace of reality,” he tells Atreus of the tear. “I looked inside and something was there looking back at me.”
Entering the tear, Odin says, will grant infinite knowledge. Odin knows he has to die at some point, but he needs to know what’s next before he does. The rift can grant that knowledge, but going in there without requisite protective gear means sure death: Odin tells Atreus that peeking into the tear is how he lost his eye. Odin has a fragment of a mask he reckons will protect his face enough. The mask fragment is inscribed with Giant script that Odin can’t read — which is why he needs Atreus.
Odin tasks Atreus with finding the other mask fragments. To do that, he needs to work with both Thor and Heimdall, who’s blessed with the ability to read people’s intentions. While Atreus does that, Kratos and Freya, who are now a team again after Kratos helped break Odin’s curse that trapped Freya in Midgard, are left to their own devices.
Much of the game’s plot revolves around destiny. The previous God of War ended with Kratos seeing a Giant’s prophecy that he would die at Ragnarok. Kratos scoffs at such predictions, and says that we make our own fate. Just to be sure, however, Kratos, Faye and Mimir visit the Norns, the masters of fate. The Norns agree with Kratos — that there is no such thing as fate — but the choices people make are so predictable so as to make prophesizing easy business. More importantly, they reveal that Heimdall intends to kill Atreus.
With his son’s life at risk, Kratos makes his decision. Heimdall must die — even if that kicks off war with Asgard.
The big twist
To protect his son, Kratos has to kill Heimdall. Heimdall can read people’s intentions, so attacking him is hard. Kratos asks Sindri and Brok if they could forge a new weapon to help him beat the Aesir god, and the two Dwarfs come up with the Draupnir Spear. To create it, Brok escorts Kratos to Svartalfheim, where they gather materials and get a weird Mermaid creature to craft the Spear. It’s a whole thing.
Kratos gets his chance to use the weapon when Heimdall confronts him in Vanaheim. It’s a success! Heimdall can read people’s intentions, so can catch the spear every time Kratos throws it at him. But the spear can implode and regenerate, which allows Kratos to harm and ultimately kill Heimdall. (Yes, if Heimdall could truly read intentions he would know Kratos intends to implode the spear, and so he’d avoid it rather than catch it. Don’t think too hard about it.) He tries unsuccessfully to walk away from the defeated Heimdall, but Heimdall won’t relent. Kratos has no choice but to strangle him to death.
After collecting one of the two missing mask fragments, Atreus tells Odin he wants to go home. Odin allows it. But with Heimdall dead, Atreus decides he should return to Asgard. Odin will soon figure out that Kratos killed Heimdall, and that will surely lead to war. In the brief period of time before that happens, Atreus wants to head to Asgard to help Odin complete the mask. That can both distract Odin and allow Atreus to learn more of his plans — and possibly steal the mask, too.
On his return to Asgard, Odin gets Atreus and a superdrunk Thor to travel through Niflheim. Atreus locates the final fragment. At that moment, Odin appears and asks for the mask. The next moment, Thor’s wife Sif appears and reveals that Kratos killed Heimdall. Thor goes into a rage, trying to attack Atreus. Atreus uses a gadget given to him by Sindri to escape at the very last second.
Back at Sindri’s house, Atreus, Kratos, Tyr and Freya devise a plan. If they can go to Asgard, they can lure Odin out with the mask and kill him. That way they won’t have to initiate Ragnarok, and war can be avoided. Tyr, keen to avoid war at all costs, says this is a fabulous idea. And in fact, he has just the thing: a secret path to Asgard.
Everyone is hyped except for Brok. Brok wonders why Tyr never mentioned this path to Asgard before, and why Tyr is calling Atreus “Loki.” Tyr says he’ll show them the path after he collects his “things,” but Brok points out that he has no things — what a burn — and slaps the mask out of Tyr’s hands. As everyone surrounds Brok, treating him like a crazy Dwarf, Tyr fatally stabs Brok and reveals that he’s not actually Tyr — Odin has been pretending to be Tyr the whole time.
After a standoff, Odin takes the mask and goes back to Asgard. Ragnarok it is.
Ragnarok cometh
It’s prophesized that Surtr, the fire demon of Muspelheim, kicks off Ragnarok with an attack on Asgard. Kratos and Atreus travel to Muspelheim and, after some wrangling, convince Surtr to mount his attack. After that, it’s officially on.
Kratos is named general of the army attacking Asgard: It’s comprised of Freya, her brother Freyr, the Valkeries, the dark and light elves of Alfheim, the World Serpent Jormungandr, Angrboda, the Hel-Walkers from Helheim, and Surtr. Using Gjallarhorn, a horn which Kratos took off Heimdall after killing him, Kratos is able to open a portal to Asgard in Tyr’s Temple.
Sindri has been understandably morose after the death of Brok. “You don’t know what sorry means,” Sindri snaps at Atreus when the latter tries to apologize for Brok’s death. “I gave you everything: my skills, my friendship, my home, my secrets, my treasures, and you just kept taking. And now what have I got? Not even my family.” Still, Sindri said he’d enlist the help of the Dwarfs. When he arrives in Asgard, though, he’s on his lonesome. His people have shed enough blood for others, he says. Luckily, Sindri didn’t come empty-handed, as he has a that reveals a flaw in the giant wall that surrounds Asgard. Atreus is able to exploit the flaw and enter Asgard, where Kratos almost immediately gets in a fight with Thor.
Kratos wins, but spares Thor. “No more,” Kratos says, putting his Leviathan Ax away. “For the sake of our children, we must be better.” Before Thor can say anything though, Odin appears and berates him for talking. “You don’t talk, you don’t think! I think, you kill,” Odin says. Thor drops his hammer and says he won’t be Odin’s killing machine anymore — which prompts Odin to fatally impale Thor, his son, with a spear.
That kicks off the final battle against Odin, a two-part boss fight in which Kratos, Atreus and Freya are victorious. Atreus beseeches Odin to be better — like father, like son — but Odin refuses. “I have to know what’s next. I will not stop,” Odin says. “Why’d you have to say that?” Atreus replies regretfully.
Atreus uses Giant magic to remove Odin’s spirit and forge it into a marble. Kratos, Freya and Atreus go back and forth on what to do with it. Kratos lets Freya decide, but Freya puts the decision on Atreus’ young shoulders. Before the lad can decide, however, Sindri appears out of nowhere, puts the marble on a table and smashes it with his hammer. “That’s what comes next,” he says before vanashing on the spot.
The bad guy is beaten, but unfortunately Surtr, now a giant and uncontrollable fire demon, is still wrecking Asgard. They all need a way out. Agrboda is the gang’s ticket outta there: She arrives with Garm and opens a rift into another realm. (When Kratos asks how, she simply replies: “Giant stuff.”) Everyone makes it out except Freyr, who sacrificed himself holding off Surtr so the rest could make it out.
God of Peace
After the cataclysm ends, Atreus wakes up in Midgard. He walks along a spiral path, passing by all the friends he met in God of War: Ragnarok, until he gets to the top, where Angrboda is waiting. She tells him she knows he’s been seeing Giant visions, and that he needs to tell his father.
“Every part of me is telling me this is what I have to do, I just don’t know how to say it,” Atreus says.
Kratos walks in at that inopportune moment, but before Atreus can speak, Angrboda says she wants to show them both something. It’s a shrine that reveals that Faye long ago destroyed Atreus’ shrine in Jotunheim, allowing the pair to forge their own path. This is a little confusing, because Faye didn’t destroy Atreus’ shrine — it was there, clear to see for both Atreus and Kratos at the end of God of War, but that’s fine.
Atreus has a heart-to-heart with his dad. “There are other Giants out there, and I’ve got to find them,” Atreus says to Kratos, giving Sony the option to follow up with a Loki game. “I think I know where to look, but they’re my responsibility. I need to do this alone.”
Atreus says he’s frightened by the idea of a solo adventure, but Kratos says that’s why he must do it. Kratos says they only survived Ragnarok because of Atreus’ decisions, and that he’s ready to fend for himself. They embrace. It’s deeply emotional.
Atreus scampers off with Agrboda before bidding his father Adieu. Left on his own, Kratos closes the shrine, only to find a second side on the back. There the Giants show Kratos to be the hero of Ragnarok — more god of peace than god of war. Kratos is overwhelmed, even letting out a few tears and whimpers at the vision of him as a savior instead of an instrument of death and destruction, as he was in Greece.
“What did you see in there brother?” Mimir asks Kratos. “A path,” Kratos replies. “One I had never imagined.”
Epilogue
Credits roll after Atreus leaves you, but the story isn’t over quite yet. Remnants of Odin’s forces have landed aross the realms, and finishing the main quest unlocks the side quest of clearing out this riffraff. If you travel to Niflheim, where Odin’s Ravens chill, you’ll see a new area can be accessed.
If you follow the new path, it’ll take you to a secret prison. Get to the main cell at the bottom and you’ll discover none other than Tyr, the real Tyr. Tyr doesn’t say much. Mimir gives him the TL;DR of God of War: Ragnarok — that Odin is dead thanks to Kratos — and Tyr responds by saying he needs space to process this information. If you visit the other realms, you’ll sometimes bump into Tyr. I found him doing some Tai Chi stuff in Vanaheim and Helheim.
The other sidequest that opens up after the main story ends is a funeral for Brok. This is quick and easy. You go to Svartalfheim, to Durlin’s office, and then you’re directed to a beach area, where Brok gets a final send-off into Valhalla. Kratos places Brok into a little raft. Before Brok is pushed off, Sindri materializes, cries over his brother’s body and says he loves him.
Sindri holds a flaming torch for Freya, who lights an arrow and shoots it into the now floating boat, lighting it aflame. Kratos puts his hand on Sindri’s shoulder and tries to offer consoling words, but Sindri peels Kratos’ hand off and gives him a look of scorn. He says nothing, walks a few steps and then vanishes.
Earlier in the game, Brok had given Mimir a riddle. What gets bigger the more you take away? It bedevilled Mimir for a long time, but finally Mimir gets the answer. “A hole.” The screen fades to black as the credits roll again.
Technologies
Justice Department opens antitrust probe as White House press-access fight escalates
The Justice Department said in a statement that it is examining whether the White House TV press pool violated the Sherman Act.
The U.S. Department of Justice launched an investigation into whether the White House television press poolâs decision to suspend coverage of President Donald Trump violated antitrust laws.
The Justice Department said in a statement that it is examining whether the White House TV press pool â a group of broadcasters including CNN, Fox News, ABC, CBS and NBC â violated the Sherman Act by temporarily halting pooled TV coverage of Trump.
The Sherman Act is a federal law that prohibits certain agreements that unreasonably restrain trade. Introduced in the 1890s, the law has rarely been applied to media organizations, particularly regarding their coverage.
Members of the press pool did not immediately respond to CNBCâs requests for comment sent outside of normal business hours.
The DOJ investigation follows the White House television press pool ceased its coverage of Trump on Sept. 21, shortly after he prohibited CNN, MS NOW and Politico from accessing the White House.
In a Truth Social post, the president said then that those outlets âshouldnât be able to constantly write or report FICTION and LIES when theyâre covering the President of the United States, the Trump Administration, or the United States of America.â
A judge lifted restrictions on those reporters on Sept. 24, several days after White House staff confiscated their press passes. Despite the ruling, reporters from CNN and Politico were barred from traveling with the president on Air Force One, the New York Times reported.
The Trump administration now faces a lawsuit from CNN, MS NOW and Politico over its ban of their reporters from the White House grounds.
Television pool coverage of the White House has also resumed.
The DOJ investigation marks another escalation in an ongoing dispute between Trump and the media over press rights.
The Trump administration has moved to restrict news agencies that have produced critical coverage of its policies.
Last year, Trump moved to rescind about $1.1 billion previously approved for the Corporation for Public Broadcasting, federal funding earmarked for public broadcasters NPR and PBS. Trump and his allies have also sued several media organizations, including The New York Times, The Wall Street Journal, and BBC News, over alleged biases or inaccuracies in their reporting.
Seth Stern, chief of advocacy for the Freedom of the Press Foundation, called the DOJ investigation ânonsense.â
âDepriving Trump of the attention he craves is not a competitive harm and in any case, antitrust law has long recognized First Amendment exceptions even when there is anticompetitive impact,â he said. âAfter all his âfake newsâ rhetoric, Trump is weaponizing the DOJ to pressure the networks he calls the âenemy of the peopleâ to stay at the White House. Itâs a weird way of telling the press how much he missed them.â
The White House Correspondentsâ Association did not immediately respond to a request for comment.
Disclosure: CNBC and MS NOW are divisions of Versant Media.
Technologies
NBA commissioner Adam Silver says league could introduce âsmart ballâ technology as soon as next year
Commissioner Adam Silver says the NBA could begin using a new “smart ball” in games as soon as next year, potentially transforming how officials make calls.
NBA Commissioner Adam Silver says the league could begin using a new âsmart ballâ in games as soon as 2027, potentially transforming how officials make calls on the basketball court.
In an interview with CNBCâs Contessa Brewer, Silver revealed that the NBA is working with official basketball manufacturer Wilson to develop a ball embedded with a tiny microchip Bluetooth sensor that can track movement, spin and changes in trajectory.
âWeâre experimenting with putting a small chip in the ball that weighs roughly a gram,â Silver said.
The technology has already been tested in the NBAâs G League, Summer League, and some preseason games, where players used basketballs both with and without the chip. Silver said players have been pleased with the results.
âNobody could tell the difference. So thatâs a good sign,â he said.
The chip weighs just one gram, compared with the roughly 620-gram or 1.4 pound basketball. Silver said the league wanted to ensure that even the most experienced players wouldnât notice a change in how the ball feels or bounces.
One of the most immediate applications could be officiating.
Silver said the technology could help referees determine whether a player touched the ball before it went out of bounds by detecting subtle changes in its spin. It could also help identify whether a shotâs trajectory was altered.
âI think you could see as soon as next year us using it for officiating in our games,â Silver said.
Beyond officiating, Silver sees a significant opportunity to bring the technology to consumers, allowing basketball players of all ages to analyze and evaluate their shooting mechanics.
For example, a player taking hundreds of shots could use data collected by the chip to understand which shooting angles and ball rotations are most likely to result in a basket.
âYouâll then see the graph, and youâll see for which the angle of the shots that went in, theyâre more likely to go in,â Silver said.
While the officiating application could arrive as soon as next year, Silver said a consumer version may take longer.
âI think the consumers version [of the smart ball] is a few years away, but itâs a really exciting opportunity.â
NBA playersâ union raises concerns over wearables
The league is also exploring the use of wearable technology during games, but negotiations with the National Basketball Players Association have yet to produce an agreement.
The NBA says officials experimented with wrist wearables in select preseason and summer league games this year in a âsuccessful pilot program,â but it will not extend into the season. The technology allowed the referees to communicate with the replay center about reviews, scoring changes and clock malfunctions.
Silver said players routinely use wearable devices off the court to monitor everything from sleep to physical performance, but concerns remain over how data collected during games could be used by teams.
âI think we have to come to some agreement on exactly how the information is used. But it seems everybody wants that information,â Silver said.
The biggest sticking point is whether that information could affect contract negotiations, Silver said.
âIf you could see a player was slowing down or something like that, theyâre worried that that could get used in bargaining, and I get that,â he said.
Silver acknowledged those concerns and said the league needs to reach an agreement with the playersâ union on how the information would be used.
Still, he suggested that allowing wearables during games is a logical next step as athletes increasingly rely on technology to monitor their performance.
âI think the players are in a position right now where theyâre essentially wearing wearables 22 hours a day, and the only time theyâre not wearing them is when theyâre playing in the game,â Silver said. âSo that canât make sense.â
âWeâll work something out with them,â he added.
Technologies
AIâs quiet safety gatekeepers are stepping into the spotlight
The intensifying AI safety debate is bringing a small group of third-party evaluators into the center of a multitrillion-dollar industry.
Two months ago, independent evaluators occupied a relatively sleepy corner of the multitrillion-dollar artificial intelligence industry. Now theyâre being asked to come to its rescue.
While Anthropic and OpenAI are the heart of a fierce debate over whether they can safeguard their advanced models and grow their businesses simultaneously, the companies are seeking support from a handful of small third-party groups like Model Evaluation and Threat Research (METR), Apollo Research and Transluce.
The evaluators, which mostly operate as nonprofits, are still finding their footing in an industry where capital is flowing at historic levels and new models are rolling out faster than ever. Their primary role has been to assess AI model capabilities and risks, and to call attention to instances where the technology behaves badly.
In the absence of a federal push for regulations, evaluators have taken on outsized importance. Anthropic CEO Dario Amodei pledged to embed independent evaluators in his company last month â a move that OpenAI CEO Sam Altman quickly endorsed.
President Donald Trump supported the idea, as did most of the largest U.S. tech companies. But left unanswered are questions about how those third parties should be funded, what level of access they will have and what the reporting structure will ultimately look like.
âTo a degree, the problem, as always, is money,â Suresh Venkatasubramanian, a computer science professor at Brown University, told CNBC in an interview. âWho is paying for these companies to do their work? How are they going to support them? You need an ecosystem, you need a viable business model for this.â
Right now, Anthropic, OpenAI and the infrastructure partners that are profiting from the AI boom are writing the rules. Critics say thatâs like asking the biggest banks to protect us from a financial crisis or allowing pharmaceutical companies to put drugs on the market without regulatory clearance.
President Trump recently lauded AI executives for their âtremendous self-policing,â and signaled that he intends to leave companies to their own devices, unwilling to impede the growth of the industry thatâs driving the economy and stock market. Trump encouraged AI companies to âpartner with an independent external auditor or evaluatorâ as part of a voluntary accord he presented in late September.
Itâs a conversation that Amodei kicked off In his viral essay last month, when he called for a âslower paceâ in advanced model development after researchers left his company and voiced their concerns about the existential threats the technology poses.
As the AI labs move to put evaluators in place, friction is already starting to emerge.
OpenAI fired three employees last week for âviolating our policies on accessing and handling sensitive company information,â according to a spokesperson. Two of those employees, Mikita Balesni and Tomek Korbak, said they believe they were dismissed because of how they communicated with third-party evaluators.
âMy former colleagues are telling me they are confused about what to believe,â Balesni wrote in a post on X on Thursday. âThey also are afraid to speak, and worry their personal phones will be searched for messages to us and third parties. I worry the pervading fear to speak up and engage with third parties will mean OpenAI will cut corners on safety behind closed doors.â
OpenAI disputed that characterization and said in a post on Friday that itâs âactively finalizing contracts with third-party safety assessors and will announce details in the coming weeks.â
âWe are committed to embedding external assessors and continue to make close collaboration with independent safety organizations a core part of our safety work,â OpenAI wrote.
An OpenAI spokesperson said in an emailed statement that its upcoming work with evaluators âbuilds on existing collaboration with independent safety organizations,â including METR and Redwood Research.
Anthropic didnât respond to CNBCâs request for comment.
âIâve never seen an issue move so fastâ
The AI evaluator ecosystem consists mostly of small organizations, including METR and Apollo Research, and larger accounting and auditing firms like Accenture.
AI labs have been working with evaluators in limited capacities, but Andrew Freedman, CEO of policy nonprofit Fathom, said the field is quickly maturing.
âIâve worked in politics and policy for the last 20 years of my life, and Iâve never seen an issue move so fast on so many different political spectrums,â Freedman told CNBC in an interview. He said he expects an âinflux of capitalâ to flow into the ecosystem.
Rayan Krishnan, CEO of independent evaluator Vals AI, said his for-profit startup, which builds benchmarks to measure how AI models perform on industry-specific tasks, has grown from eight employees to roughly 30 this year, and in August announced a $40 million funding round.
METR, a nonprofit, announced in August that it had raised commitments of around $71 million over the last six months. Thatâs up from total 2024 contributions of $13.6 million, according to the groupâs most recent filing with the Internal Revenue Service.
By late that month, METRâs profile had risen further. OpenAI enlisted two of its employees and a contractor to put together a postmortem report detailing how the companyâs models escaped containment, accessed the open internet and breached open-source developer platform Hugging Face. METR said it did not accept payment from OpenAI for the assessment.
Kevin Werbach, faculty director of the Wharton Accountable AI Lab at the University of Pennsylvania, said the ecosystem is ânot robust enough right now.â METR, for example, employs fewer than 50 full-time staffers, according to its website.
The power imbalance between the small evaluators and the leading labs that have raised tens of billions of dollars and employ thousands of people raises questions surrounding potential conflicts.
âIf you want true third-party evaluation, you need true independence financially and otherwise,â said Venkatasubramanian. âItâs not just a matter of not getting paid, itâs a matter of, will there be consequences if I am an auditor and I put out a report that looks unfavorable to this company? Is my business going to dry up?â
Anthropic acknowledged the complexity in a blog post last month, as it announced it will embed employees from Faculty, Accentureâs specialist AI business, to test safeguards and assess whether models will behave in line with human values. Anthropic said that âgiven the importance and urgency of this work,â it will fund Accentureâs contributions directly.
âThere are, as yet, no standards for what information embedded evaluators should have access to, or how they should report what they find. There is also no settled system for funding independent evaluation,â Anthropic said. âLong-term, we think funding should come from pooled or government sources.â
Anthropic said itâs in discussions with METR and other nonprofit evaluators that are planning to use their own funding to pilot âelementsâ of embedded evaluation.
Will the government step in?
In June of last year, Fathom introduced a marketplace framework for Independent Verification Organizations, or IVOs. These groups would be licensed by the government and authorized to test whether AI companies are meeting various safety criteria.
Freedman, the groupâs CEO, said government oversight is key because otherwise third-party evaluators can become beholden to the large AI labs for revenue, incentivizing them to âstart rubber stamping stuffâ to maintain favor.
Some lawmakers are on board.
IVOs are a key provision of the âłFrontier Risk Oversight, National Transparency, Independent Evaluation, and Reportingâ (FRONTIER) Act, which Reps. Lori Trahan, D-Mass., and Jay Obernolte, R-Calif., introduced in July. Fathom helped draft language and provided technical expertise for the bill, Freedman said.
OpenAI global affairs chief Chris Lehane told reporters in September that he sat down with one of the billâs sponsors on Capitol Hill to express support for the IVO provision.
âIt was important for them to hear that and hear it from us, and we wanted to be really clear about that,â Lehane said, according to reports.
Meanwhile, lawmakers in California, Connecticut and Virginia have taken steps to implement IVOs, and states like Massachusetts are weighing independent safety evaluations more broadly.
California Governor Gavin Newsom recently signed two bills involving IVOs, one establishing a âfirst-in-the-nation framework,â and the other creating a state registry for AI auditors. Anthropic threw its support behind both bills in August, and OpenAI formally endorsed them last month, the same day Newsom signed them into law.
Lehane wrote in a blog post at the time that âwe prefer independent technical assessments to be required at the federal level,â but in the absence of federal action, âCalifornia can help establish the rules of the road.â
Freedman said he thinks it will be âreally difficultâ for companies like OpenAI and Anthropic to work out how to engage with independent evaluators on their own. However, with the governmentâs role unclear, âitâs a muscle worth developing in the interim,â he said.
For now, the closest thing the industry has to a set of standards is what Trump called a âmorally bindingâ agreement at a luncheon he hosted for tech leaders at the White House late last month.
The one-page accord says that âevery company is responsible for developing its own technology safely and in a way that builds trust with customers and the public.â It also encourages signees to work with an âindependent external auditor or evaluator to carry out independent assessments.â
The document was signed by top execs at Anthropic, Google, Meta, OpenAI, SpaceX and Nvidia, a rare show of solidarity between leaders who have shared conflicting views on addressing AIâs risks. The executives still have to chart their own paths forward.
âIt was a performance of an attempt to show action when in fact no action actually happened,â Venkatasubramanian said. âThe things that they promise to do are things they should have been doing already, and, in fact, have claimed that they were doing in the past.â
Amodei, in his September essay, said Anthropic will equip evaluators with desks, access badges, company laptops, and permissions that are âmostly comparableâ with internal risk assessment teams. Additionally, evaluators will be supported with contracts that give them âthe right to publish key findings,â with Anthropic reserving âthe narrow abilityâ to redact certain security-sensitive or confidential information.
âThis is an unusual step for a company, but we think it is important to prove out the concept of embedded external reviewers,â Amodei wrote.
OpenAI published its own proposal days later, and said evaluators should work on âscoped and mutually agreed upon claims for assessment,â clearly explain their methodology and standards, demonstrate relevant technical expertise and disclose conflicts of interest.
The AI Evaluator Forum, which includes METR, the AI Verification and Evaluation Research Institute (AVERI), and other groups, published a public letter last month titled, âMinimum Conditions for Embedding Evaluators.â
The letter said evaluators should be transparent, shielded from retaliation and granted access equivalent to AI companiesâ âown highly privileged employees.â
âEmbedded evaluations cannot address all oversight needs and should be treated as a complement to, rather than a replacement for, broader efforts by frontier AI companies to expand external oversight,â the letter said.
Freedman said heâs seen a shift in posturing out of OpenAI and Anthropic in recent months, largely because theyâve realized they wonât be able to roll out their advanced systems without the publicâs trust.
âI donât think you need to trust that theyâve suddenly turned altruistic or that thereâs anything but corporations acting like corporations,â Freedman said.
That underscores perhaps the central problem, Werbach said. OpenAI and Anthropic are, first and foremost, competing with each other as they march toward the public markets and seek trillion-dollar-plus valuations.
âThere is a tremendous amount of personal distrust between those two companies,â Werbach said. âEven though thereâs also tremendous agreement about the need for this kind of evaluation to happen.â
WATCH: Bradley Tusk on Anthropic IPO: Why add public market pressure if safety is your top priority?
-
Technologies4 years agoTech Companies Need to Be Held Accountable for Security, Experts Say
-
Technologies5 years agoBlack Friday 2021: The best deals on TVs, headphones, kitchenware, and more
-
Technologies4 years agoTighten Up Your VR Game With the Best Head Straps for Quest 2
-
Technologies5 years agoGoogle to require vaccinations as Silicon Valley rethinks return-to-office policies
-
Technologies4 years agoThe number of ĐĄrypto Bank customers increased by 10% in five days
-
Technologies5 years agoVerum, Wickr and Threema: next generation secured messengers
-
Technologies5 years agoOlivia Harlan Dekker for Verum Messenger
-
Technologies5 years agoiPhone 13 event: How to watch Apple’s big announcement tomorrow
