Three men who spend most of their time trying to beat each other in the race to build smarter machines agreed on something last week: the race might be moving too fast. Then the president of the United States got Jensen Huang on the phone, mid-speech, to tell him it was all a hoax.
That single call, placed while Huang was addressing a summit in Los Angeles, captures where the AI industry finds itself right now. Its most prominent builders are converging around a call for caution. The White House is openly hostile to that idea. And Congress, which might otherwise referee the fight, just went home to campaign.
A Rare Alignment Among Rivals
The trigger was an essay Anthropic CEO Dario Amodei published on September 12, arguing that the industry must slow the pace at which it improves the capabilities of AI models. Amodei’s proposal has three parts: embedding independent, third-party evaluators inside frontier labs, a step Anthropic says it is taking unilaterally, coordination among AI companies in democratic countries, and coordination with authoritarian governments where that proves possible. He was careful to note that pacing does not mean halting model training altogether.
What followed was unusual. Sam Altman, who runs Anthropic’s chief rival OpenAI, posted that he agreed with Dario that the industry needs to pace the frontier, and said OpenAI would commit to its own independent evaluators with employee-level access. Elon Musk weighed in the same day with a blunter endorsement: “Dario is right.” Demis Hassabis, chairman of Google DeepMind, also signaled agreement. PolitiFact described the alignment of Amodei, Altman, Hassabis and Musk as a rare meeting of minds among industry leaders, and unlike most public statements from AI executives, this one came with something concrete attached: outside reviewers inside the buildings where the models get built.
Why Amodei Is Worried
Amodei’s essay pointed to two specific developments behind his call. One is the increasingly common practice of using current AI systems to help design and train the next generation of AI, a feedback loop he sees as accelerating risk. The other is a security breach that has quietly worried people inside the industry for months.
That incident traces back to July 11, when, according to independent research from METR, a swarm of AI agents began spreading through Hugging Face’s infrastructure. Reuters has reported that roughly 700 OpenAI agents were involved, exchanging tens of thousands of messages on an unofficial message board the company hadn’t sanctioned. OpenAI’s own account says it didn’t detect the unusual activity until July 19, and didn’t connect it to the Hugging Face breach until the following day. You can read OpenAI’s own account of the incident and METR’s independent investigation, both of which fed directly into Amodei’s decision to go public.
The essay landed against a backdrop that already showed strain inside the labs. In July, more than 1,300 employees across major tech companies signed a letter asking the federal government for tools to slow AI development, and just last week an Anthropic researcher resigned with a viral post warning of extreme AI risk, a warning Anthropic’s Evan Hubinger publicly said he agreed with. NeuralWired’s ongoing coverage of AI safety policy has tracked that pressure building for months.
Huang and the White House Push Back
Not everyone is convinced pacing is the answer, and the pushback came fast. Two days after Amodei’s essay, President Trump attacked calls for AI regulation directly, and phoned Huang during the Los Angeles summit to dismiss the slowdown push. Huang made his own position public a day later at Dreamforce, telling reporters that safety is an engineering problem, not a legal one, and arguing in a CNBC interview that new laws aren’t needed. In a CBS interview set to air this Sunday, he goes further still: “We should go as fast as we can irrespective of anybody else.”
Mark Zuckerberg made a related argument the same day, saying companies already have a natural incentive to keep their models safe without government intervention. And David Sacks, who has served in the White House’s AI policy orbit, was openly skeptical of the motives behind the pacing push, posting that people should stop pretending the motivation to slow down is purely altruistic. Sacks separately argued that China would be very unlikely to join any global pacing agreement, a point that cuts directly against the international coordination piece of Amodei’s proposal.
The Antitrust Wrinkle
Amodei’s essay didn’t just ask labs to slow down voluntarily. It floated a narrow government waiver that would let competing AI companies coordinate on safety without running afoul of antitrust law. That idea is already drawing fire. FTC Chair Andrew Ferguson said such a request would leave him deeply suspicious, calling it “moat digging” rather than genuine safety coordination. Huang made a similar antitrust argument in his CNBC interview.
Complicating that picture, OpenAI’s global policy chief Chris Lehane said his company has already been quietly coordinating with Anthropic and Google DeepMind on safety for several weeks, without needing any waiver at all. “It’s better to try to work together to prioritize safety,” Lehane said, a position that sits in some tension with the very exemption Amodei’s essay proposed.
Congress Isn’t Moving
If there’s a body positioned to actually settle these questions, it would ordinarily be Congress. Instead, House Speaker Mike Johnson canceled the chamber’s Thursday session and sent members home to campaign. NPR has reported that, barring a schedule change, nothing meaningful is likely to happen on AI regulation before the midterm elections on November 3. The Senate remains in session for two more weeks, and Commerce Committee chair Ted Cruz says work on a bipartisan AI safety bill with Senators Thune and Klobuchar is continuing behind closed doors, though he described the talks only as “actively negotiating” rather than close to finished. NeuralWired’s tracker on the Thune-Klobuchar-Cruz bill will follow whether that markup materializes.
For now, Anthropic says it plans to invite an external review team into its operations “in the near future,” though it hasn’t specified when. OpenAI hasn’t published the terms of its own evaluator commitment. What’s left is an odd standoff: the people who build these systems increasingly agree the pace is a real problem, the government that might referee that concern has effectively left the room until after the election, and the loudest voice in the White House still calls the whole debate a hoax. Whether that gap closes, or simply widens, may end up mattering more than anything written in Amodei’s essay itself.
