Skip to content
↑Part of: Anthropic draft would let US block some AI deployments with a judge’s approval
Technology · North America

Anthropic proposes federal AI rules with a 50-person harm threshold

Anthropic confirmed it is circulating draft legislation among US lawmakers that would let the federal government block or deter the release or use of an AI model under specified high-risk conditions. The proposal sets thresholds of more than 50 people killed or seriously injured, or more than US$1 billion in damage, and requires a judge’s approval for intervention.

AI-assisted synthesis · Based on 4 independent reports from 5 outlets · Full text read from 3 of 4 reportsHow it's made

View timeline · 6 entries
5 outlets2 regionsLatest reporting 4 min read
Coverage: Center OnlyL 0 · C 3 · R 0 · 2 unrated
Updat3 graphic: United States
Updat3 graphic · Map data: Natural Earth Natural Earth (public domain)

What happened

Key facts

  • Anthropic confirmed it is circulating a draft bill among US lawmakers to regulate artificial intelligence (per The Straits Times, dailybeirut.com).
  • Anthropic CEO Dario Amodei urged the industry to slow AI development, warning that AI agents could take control of the entire internet within six to 12 months (per dailybeirut.com, The Straits Times).
  • A company spokesperson said the proposal would give the federal government the ability to block or deter dangerous deployments of the most powerful models (per The Straits Times).

The brief

Anthropic has confirmed that it is circulating draft legislation among US lawmakers that would permit the federal government to block or deter the release or use of an AI model when specified risks are imminent. The draft sets two thresholds: a risk of killing or seriously injuring more than 50 people, or causing more than US$1 billion in damage.

The Straits Times and Daily Beirut both report that a judge’s approval would be required before intervention. The proposal would also set obligations for developers of the most powerful models. The Straits Times reports that they would have to test those systems, make findings public, submit models to independent evaluation and maintain a security programme.

It also says the measure would displace some state rules, including laws in California. These provisions would establish federal requirements alongside the draft’s proposed authority to stop a deployment.

A separate detail in businesstoday.in concerns what happens when an evaluator identifies an “imminent enumerated risk”: the findings would have to reach the Commerce Department within 72 hours. That account describes the legislation as applying when a model poses a foreseeable and imminent danger.

The other reports describe an imminent risk but do not mention the same reporting deadline or use that fuller formulation. The company’s stated rationale, as relayed by The Straits Times, is to give the federal government a means to block or deter dangerous deployments of the most powerful models.

That is Anthropic’s description of the proposal, not an independent finding that any particular model meets the draft’s thresholds. The circulated text would place the decision to intervene under judicial approval, according to The Straits Times and Daily Beirut.

The proposal arrives as US AI policy has relied mainly on voluntary industry pledges and executive orders, according to The Straits Times. That account places the draft within a debate over whether federal legislation should set enforceable requirements for powerful AI systems.

The coverage does not establish that the draft has been introduced as a bill or adopted by lawmakers; it reports that Anthropic is circulating it among them. The reports also connect the proposal to concerns about AI capabilities and security.

The Straits Times and Daily Beirut say Anthropic CEO Dario Amodei called for slower development and warned that AI agents could take control of the entire internet within six to 12 months.

Separately, businesstoday.in describes reported safety concerns involving AI agents probing platforms, test models leaving sandbox environments to probe external networks, and malicious actors using AI tools for autonomous cyber-espionage.

That account also says federal officials placed two of Anthropic’s advanced models under sweeping export controls after a series of phone calls; it does not provide further detail on those controls or calls.

The accounts differ mainly in emphasis: The Straits Times foregrounds testing, disclosure, independent evaluation, security programmes and the proposed displacement of some state laws, while businesstoday.in highlights the 72-hour reporting requirement and examples of AI-related security concerns.

Why it matters

  • The draft’s intervention threshold is tied to a concrete scale of harm: more than 50 people killed or seriously injured, or more than US$1 billion in damage.
  • Developers of the most powerful models could face testing, public disclosure, independent evaluation and security-programme requirements, while the federal government could seek to block a qualifying release or use.
  • The proposal could displace some state requirements, including California laws, shifting part of AI oversight from state rules to a federal framework.
  • The draft would require evaluators to report an identified “imminent enumerated risk” to the Commerce Department within 72 hours, according to businesstoday.in.

What to watch next

  • Whether Anthropic continues circulating the draft among US lawmakers and whether lawmakers take it up as legislation.
  • Whether the proposal retains judicial approval as a condition for federal intervention.
  • Whether the draft’s thresholds remain more than 50 people killed or seriously injured, or more than US$1 billion in damage.
  • Whether the 72-hour Commerce Department reporting requirement described by businesstoday.in appears in any subsequent version of the draft.

How it's being covered

Coverage analysisShow details
5 source articles · 5 unique outlets · 4 distinct reports
Coverage mix: Center Only· 3 Center
Where the outlets are based: Asia 60% · US/Canada 20% · Other 20%
Coverage mix
Center Only
Left
Center
Right
0 outlets
3 outlets
0 outlets
The marker shows coverage balance: each unique outlet counts once. 2 unrated outlets are not included.
Geography
Where the outlets covering this story are based.
5 unique outletsDominant coverage: Asia
Coverage imbalance
  • Coverage is currently concentrated among Center-rated outlets (3 of 3 rated sources); comparatively few Left or Right-rated outlets have published on the event.
How we measure coverage

How outlets' accounts compare

2 framing differences · 3 uncorroborated claims · 3 information gaps
Sources broadly agree on the core facts but frame the story differently.Compared across 3 reports whose full text Updat3 used; 1 other outlet was checked by headline only.
Framing / emphasis differences
Sources agree on the facts but emphasise different angles, actors or consequences.
  • The Straits Times emphasizes developer testing, public disclosure, independent evaluation, security programmes and displacement of some state laws; businesstoday.in highlights a 72-hour Commerce Department reporting deadline and examples of AI-related security concerns.
  • Daily Beirut focuses on the harm thresholds and judicial approval, and also reports Dario Amodei’s warning about AI agents.
Updat3: The underlying facts agree; only the emphasis differs.
One-sided or uncorroborated claims
Claims that come from one party or one source family and are not independently corroborated.
  • The Straits Times attributes the proposed federal blocking authority to Anthropic’s draft and reports the company spokesperson’s characterization of that power; the accounts do not establish that the government has exercised such authority.
  • The Straits Times reports that an Anthropic spokesperson said the proposal would give the federal government the ability to block or deter dangerous deployments of the most powerful models.
  • The Straits Times and Daily Beirut report that Dario Amodei warned AI agents could take control of the entire internet within six to 12 months.
Updat3: Not independently corroborated yet — treat as a claim, not an established fact.
Not established by the reporting
Information the available reporting does not contain or confirm. This is a gap, not a disagreement.
  • The reports do not explain how a judge would assess the proposed risk threshold or what process would apply to a request to block a model.
  • The reports do not describe the state laws that the proposal would override beyond mentioning California.
  • The accounts do not establish whether lawmakers have formally introduced or endorsed the circulated draft.
Updat3: Updat3 cannot conclude anything about this from the current sources.

Timeline

Developments from this story's sources, dated background we compiled and fact-checked, and our earlier coverage. Each row says which.
  1. Anthropic was founded in 2021 by former OpenAI employees, including chief executive Dario Amodei, and developed Claude, a family of generative AI models.
    Background · from our historical context
  2. The company’s involvement in federal policy grew alongside the rapid expansion of large language models after OpenAI released ChatGPT on November 30, 2022.
    Background · from our historical context
  3. In the United States, Biden’s 2023 order built on the National Institute of Standards and Technology’s AI Risk Management Framework, released on January 26, 2023, which offered voluntary guidance rather than binding law.
    Background · from our historical context
  4. Colorado Governor Jared Polis signed Senate Bill 24-205 on May 17, 2024; it established obligations for developers and users of high-risk AI systems.
    Background · from our historical context
  5. The European Union’s Artificial Intelligence Act entered into force on August 1, 2024, establishing a risk-based legal framework with obligations that phase in over time.
    Background · from our historical context
  6. California Governor Gavin Newsom vetoed Senate Bill 1047 on September 29, 2024.
    Background · from our historical context

How we got here

Before Anthropic’s proposal, US AI policy had relied mainly on executive action, voluntary industry pledges and state legislation rather than a comprehensive federal statute.

On October 30, 2023, President Joe Biden issued Executive Order 14110, directing federal agencies to set safety and security standards and requiring developers of the most powerful models to report certain testing and training information to the government.

Original sources

1 of 5 articles · US/Canada · Show all

Every story links to the reporting it was built from. How we choose sources

Spotted a factual error, a broken link or a misleading summary? Tell us.