Anthropic Backs AI Pacing Petition, but the Race Has No Brakes Yet
- Martin Chen
- 6 hours ago
- 12 min read
Anthropic has endorsed a petition signed by 1,293 frontier AI employees, despite intense pressure on every major laboratory to keep advancing. CEO Dario Amodei, several co-founders, and senior employees added their names. The company says governments should prepare tools that can slow automated AI development if the risks become unacceptable.
The endorsement matters because the petition does not demand an immediate halt. It asks the United States to support an international effort that would make deliberate pacing possible. That distinction separates the initiative from earlier letters demanding fixed pauses.
It also exposes the central conflict. Anthropic argues that society needs an emergency brake, while acknowledging that no responsible laboratory can safely use it alone. OpenAI, Google DeepMind, Meta, and other frontier developers face the same race, even when their employees share the concern.
Anthropic Turns an Employee Petition Into a Company Position
Anthropic has moved the pacing debate from employee dissent to an official position endorsed by its leadership.
The pacing statement says leading AI companies believe they are approaching the automation of AI research. Its signatories warn that this transition might accelerate capability development beyond society’s ability to understand or control the resulting systems.
The letter’s request is narrow. It asks the U.S. government to support an international effort for developing technical and governance tools. Those tools would help participating countries deliberately pace automated frontier AI development.
“Frontier AI” refers to the most capable general-purpose systems under development. “Automated AI development” goes further than using a chatbot for code suggestions. It means models performing substantial parts of the research and engineering required to create their successors.
Anthropic confirmed its support through an official company endorsement. The post said the petition had been signed by Amodei, several co-founders, and senior staff. It connected the endorsement directly to Anthropic’s recent research on recursive self-improvement.
That endorsement gives the petition unusual institutional weight. Employees often sign open letters in a personal capacity, leaving their employers free to remain neutral. Anthropic instead adopted the petition’s basic diagnosis as its own.
OpenAI also supported the initiative, according to reporting published after the letter appeared. Employees from Google DeepMind, Meta, Microsoft, Thinking Machines, and several other organizations signed in personal capacities.
The total continued rising after the petition’s launch. The website listed 1,293 employees when reviewed on July 30, up from the roughly 1,100 reported when news organizations first covered it. Because the list remains open, that figure represents a changing count rather than a fixed launch total.
The signatories include researchers and leaders who disagree on many other policy questions. John Schulman, chief scientist at Thinking Machines, said the statement helps establish shared awareness about potential coordination needs. Meta AI chief scientist Shengjia Zhao also signed.
Ilya Sutskever, co-founder of Safe Superintelligence, warned that any intervention would have to work internationally. He also acknowledged that poor implementation could make the situation worse. That caveat captures the petition’s deepest problem.
The statement does not identify a specific model that should trigger a slowdown. It provides no binding threshold, monitoring authority, inspection system, or enforcement mechanism. It asks governments to start building those tools before an emergency forces them to improvise.
This makes Anthropic’s action more consequential than a general safety declaration. The company is saying that an international braking system should exist, even though it has not defined the complete machinery.
Why Anthropic AI Research Changed the Timing
The petition arrived now because AI is no longer merely assisting model developers. It is beginning to perform larger pieces of their work.
Anthropic’s June report, AI builds itself, provides the evidence behind its position. The company describes recursive self-improvement as a system autonomously designing and developing its own successor.
Anthropic stresses that current systems have not reached that point. It also says full recursive improvement is not inevitable. However, internal data suggests the development process is becoming increasingly automated.
As of May 2026, Claude reportedly authored more than 80 percent of the code merged into Anthropic’s codebase. The proportion was in the low single digits before Claude Code entered research preview in February 2025.
Anthropic says its typical engineer merged eight times as much code per day during the second quarter of 2026 as during 2024. The company openly cautions that code volume is an imperfect productivity measure. More lines do not automatically mean better software or eight times more valuable work.
That caveat matters. AI can generate repetitive code, tests, migrations, and documentation without producing an equivalent increase in difficult reasoning. A laboratory could therefore report much higher output while advancing its central research problems more slowly.
Another internal measurement offers a different view. In a March 2026 poll of 130 Anthropic research employees, the median respondent estimated four times more output with Mythos Preview. Anthropic again cautioned that the true gain was probably lower.
The company’s strongest evidence concerns work with clear objectives. In one recurring optimization exercise, Claude Opus 4 produced an average threefold speedup in May 2025. Mythos Preview reportedly reached roughly 52 times the starting performance by April 2026.
A skilled human researcher typically achieved about a fourfold improvement after four to eight hours on that exercise. Anthropic warns that the result should not be interpreted as a comparable increase across real model training.
The progression still matters because it illustrates a closed experimental loop. The model changes code, runs the experiment, measures the outcome, and tries again. A human establishes the objective and evaluation rules but does not dictate each step.
That is not full recursive self-improvement. The system is optimizing a target selected by people, rather than deciding which successor to build. Anthropic says substantial gaps remain when models must exercise judgment, choose goals, or identify the most useful research direction.
Yet partial automation can accelerate the race before complete autonomy arrives. A laboratory that finishes experiments faster can test more ideas, reject weak paths sooner, and begin training its next system earlier.
The same capability can help alignment research. Alignment is the effort to make model behavior follow human goals and constraints. Faster experiments can improve evaluations, interpretability methods, and safeguards alongside general capabilities.
That dual use creates the timing problem. The tools needed to study advanced systems are often the same tools that help build them. Better research agents can accelerate safety work and capability work simultaneously.
Anthropic’s argument is therefore not that an uncontrolled intelligence explosion has started. It is that society should prepare before automated research makes each development cycle materially shorter.
The Real Opponent Is Coordination Failure
The main contest is not Anthropic against OpenAI. It is collective caution against a race that punishes any laboratory acting alone.
Every frontier developer has incentives to keep moving. New models attract users, enterprise contracts, technical talent, capital, and strategic partnerships. Falling behind can reduce a company’s influence over the safety standards eventually adopted.
National competition adds another layer. U.S. policymakers want domestic companies to retain an advantage over Chinese laboratories. Any proposal that slows American developers will face questions about whether competitors elsewhere will follow.
Anthropic acknowledges this directly. Its research says an isolated pause could allow less cautious actors to catch up. That outcome might replace one front-runner without reducing the overall danger.
A meaningful intervention would require several well-resourced laboratories in several countries to act under comparable conditions. Participants would need to know that competitors had genuinely slowed their work.
Verification is harder for AI than for many weapons programs. A missile installation has specialized equipment and visible infrastructure. AI development uses data centers, chips, software, and networking equipment that also serve ordinary commercial purposes.
Training runs can also be hidden or divided. Governments would need monitoring methods that distinguish prohibited development from allowed deployment, evaluation, academic research, and smaller-scale experimentation.
The system would need a trigger. A government might act when a model passes a dangerous cyber evaluation, automates a specified portion of AI research, or completes complex tasks over longer periods. Each option creates measurement and enforcement disputes.
It would also need an exit rule. A pause without clear conditions for resuming development could become permanent through political inertia. A weak exit rule could let participants restart before the underlying risk had changed.
Finally, an authority must decide whether the trigger has been reached. A laboratory cannot credibly serve as the sole judge of its own models. A national agency might lack access abroad, while an international body would take time to negotiate and fund.
These details explain why the petition asks for tools instead of an immediate slowdown. Its authors are trying to create an option that does not currently exist.
The proposal resembles arms-control preparation more than ordinary product regulation. It requires shared measurements, inspection procedures, communication channels, and consequences for concealment. Those components cannot be assembled during a fast-moving technical crisis.
Anthropic’s own position contains the tradeoff clearly. The company says it would consider slowing or temporarily pausing if other developers near the frontier did so in a verifiable way.
That condition is defensible, but demanding. A mechanism that works only when every important rival cooperates can fail because of one holdout, one hidden program, or one disagreement over capability measurements.
The alternative is no easier. Unilateral restraint can become a competitive transfer from the most cautious organization to the least cautious one. The result might produce faster development under weaker safeguards.
The petition’s broad support shows that researchers recognize this collective-action problem. It does not show that governments or companies have solved it.
A Petition Is Not an AI Brake
The strongest criticism is straightforward: Anthropic is endorsing an option without specifying how that option would work.
The letter contains no detailed policy proposal. It does not define the development activities subject to pacing, the capability thresholds involved, or the countries required for a credible agreement.
It also leaves open whether “pacing” means delaying a public release, limiting a training run, restricting computing capacity, or pausing research automation. Those interventions would have different costs and enforcement requirements.
A release delay would give laboratories more evaluation time but would not necessarily slow internal capability growth. A training restriction would reach deeper into research, but it would demand intrusive monitoring.
Limits on automated research would face a classification problem. Coding assistants already contribute to ordinary engineering, security reviews, and model evaluation. Regulators would need to separate benign assistance from systems capable of substantially accelerating successor development.
Critics also question why laboratories need the government to restrain work they control. Former Microsoft executive Steven Sinofsky argued that employees concerned about their companies’ direction can leave or seek different work.
That criticism misses part of the petition’s logic. One employee or company cannot stop a multi-company race. Still, it exposes a real accountability gap if supporters demand public intervention without proposing voluntary measures inside their own organizations.
Laboratories could publish common evaluations, disclose more information about AI-assisted research, and establish shared incident reporting before governments act. They could also agree on preliminary warning thresholds without immediately limiting development.
Schulman’s comment on the petition supports that direction. He said laboratories should start designing coordination mechanisms voluntarily, even before U.S. government involvement.
Another concern involves market power. Complex licensing, compute monitoring, and mandatory evaluation systems could favor companies that already control extensive infrastructure. Smaller laboratories and independent researchers might struggle with compliance.
A pacing regime could therefore reduce competition while leaving the largest companies in command of advanced systems. That possibility deserves attention because the companies warning about frontier risk also hold strong commercial interests.
Anthropic’s broader policy position intensifies the scrutiny. The company has supported stronger controls around advanced models while continuing to release more capable Claude systems.
That behavior is not necessarily contradictory. A company can believe competitive development should continue until a coordinated alternative exists. It can also advocate rules that apply equally to rivals.
However, the arrangement creates an obvious credibility test. Anthropic must demonstrate that its preferred controls target measurable risks rather than technologies or competitors that threaten its market position.
The company’s recent stance on open-weight models illustrates the tension. Open-weight systems let users download and modify model parameters. Supporters say they improve access, research, competition, and national control over technology.
Anthropic argues that the most capable open systems can become difficult to contain after release. The company declined to join a separate industry letter opposing broad restrictions on open weights, leaving it isolated from several major technology companies.
An industry policy split does not invalidate Anthropic’s safety case. It does show that the meaning of “responsible pacing” will be contested.
Meta, Nvidia, and open-model advocates will resist rules that place downloadable systems at a structural disadvantage. Closed-model laboratories will argue that irreversible releases require special treatment.
Governments must address that disagreement without letting companies write rules around their own business models. Otherwise, a safety framework can become an industrial policy favoring whichever group has the strongest access to regulators.
The petition should therefore be read as a request to begin institutional design, not evidence that a workable regime exists. Its value lies in identifying the missing brake. Its weakness is the absence of an engineering plan for building one.
What Anthropic’s Position Means for AI Users and Companies
The immediate impact is not a slower Claude release schedule. It is greater uncertainty about how frontier systems will be evaluated, governed, and purchased.
Developers should not expect the petition to stop model improvements next month. It creates no binding obligation, and Anthropic has not announced a pause tied to the endorsement.
The near-term change will appear in policy discussions. Governments can now point to public support from employees and leaders across competing laboratories when proposing evaluations or monitoring requirements.
Enterprise buyers should watch those discussions because model governance affects procurement. A company integrating frontier systems into coding, research, customer support, or security needs to know whether future releases could face delays or usage restrictions.
Buyers should also distinguish model performance from model continuity. The highest-scoring system is not automatically the safest long-term dependency if access can change after an evaluation, policy dispute, or security incident.
Teams can reduce that exposure by maintaining model-independent workflows. They should preserve prompts, evaluations, source materials, and decision records outside any single provider’s interface.
That practice matters when a model changes behavior or becomes unavailable. A searchable technical knowledge base can preserve the context required to compare replacements without reconstructing every decision.
Software teams should also create their own acceptance tests. Provider benchmarks rarely capture a company’s actual codebase, risk tolerance, approval process, or regulatory obligations.
If automated research advances as Anthropic expects, update cycles will become harder to manage. A model might gain meaningful capabilities between scheduled security reviews or procurement checkpoints.
Enterprises will need faster evaluation processes without abandoning human accountability. That includes testing model behavior, documenting changes, and defining which tasks require approval.
Knowledge workers face a related issue. Faster systems can produce more analysis, code, and documents than teams can review. Output volume becomes a risk when human verification capacity remains fixed.
Anthropic’s own code statistics illustrate this imbalance. Eight times more merged code does not mean eight times more human attention for security, architecture, and maintenance.
Organizations should measure error correction, review time, incidents, and downstream value alongside generated output. Otherwise, an apparent productivity gain can conceal additional verification work.
Security teams have the strongest reason to pay attention. Research automation can help defenders discover vulnerabilities, but it can also lower the cost of offensive experimentation.
A pacing mechanism might eventually focus first on cyber capabilities because they can be evaluated through controlled exercises. That would affect how laboratories release agentic coding tools or grant access to their most capable models.
For individual users, the petition is mostly a governance signal. It says the people building frontier systems increasingly believe development speed has become a policy variable, not an unavoidable natural force.
The important phrase is “option to buy time.” Supporters are not saying every advance should stop. They are arguing that society should be able to respond when measured risks rise faster than institutions can adapt.
Whether that option protects users depends on its design. A transparent mechanism could create more evaluation time during dangerous transitions. An opaque mechanism could centralize control while offering little independent evidence of increased safety.
Three Signals Will Show Whether Pacing Becomes Real
The next test is whether Anthropic and other supporters convert a short statement into thresholds, verification methods, and international participation.
The first signal is a concrete evaluation threshold. Anthropic’s research arm plans to convene policymakers, researchers, civil society organizations, and competing laboratories during the coming months.
Those conversations should produce more than general principles. A credible proposal needs observable conditions that justify intervention. These might involve autonomous research performance, dangerous cyber capabilities, or sustained operation without human correction.
The chosen measurements must survive independent review. Anthropic’s internal productivity data is informative, but a company cannot establish public policy using private evidence alone.
External evaluators need access to systems, methods, and reproducible results. They also need clear procedures for handling sensitive capabilities without publishing instructions that increase misuse.
A public threshold would strengthen Anthropic’s case because it would turn “too fast” into a testable claim. Continued reliance on broad warnings would weaken it.
The second signal is a verification proposal that includes international competitors. The core problem is not convincing Anthropic to pause. It is determining whether other frontier programs have also slowed.
A workable proposal must explain what can be monitored, which actors receive access, and how violations are detected. It must account for commercial cloud infrastructure, private data centers, and government programs.
China is central to that question, but it should not become an excuse for avoiding preliminary work. U.S. companies and agencies can develop measurement standards before a complete diplomatic agreement exists.
Technical monitoring can also improve without immediately creating binding limits. Laboratories could register major training runs, share standardized evaluation results, or report unusually capable research agents to an independent body.
Such measures would not guarantee compliance. They would help reveal whether the verification problem is manageable or fundamentally incompatible with present infrastructure.
Meaningful participation by non-U.S. developers would strengthen the pacing argument. A plan limited to domestic companies would leave its main competitive risk unresolved.
The third signal is voluntary action by the petition’s supporters. Anthropic, OpenAI, and other laboratories do not need a treaty to improve transparency or coordinate evaluations.
They can publish definitions for automated AI research, identify warning indicators, and describe internal escalation procedures. They can also disclose when a model materially changes the speed of successor development.
Anthropic has already supplied more internal evidence than most competitors. Its next step should connect that evidence to decisions. Readers need to know which observed change would cause the company to delay training, deployment, or release.
Voluntary commitments would not replace government oversight. They would show that supporters view pacing as an operational safety project rather than a public-relations position.
Failure to act would reinforce the critics’ argument. Laboratories would continue racing while asking governments to solve a problem they have not translated into practical controls.
The petition has succeeded at one important task. It has shown that concern about automated AI development crosses company lines, technical roles, and long-standing policy divisions.
It has not built the brake it requests. No shared trigger exists, no international verification system is operating, and no authority can yet impose a coordinated pause.
That gap is now the story. Anthropic has publicly accepted that frontier development might need deliberate pacing, but its endorsement raises the standard for what comes next.
Watch for published thresholds, international monitoring proposals, and voluntary laboratory commitments. If those appear, the petition will have started a governance process. If they do not, Anthropic will remain in the same race, calling for brakes while every competitor keeps accelerating.