Anthropic proposes federal AI rules with a 50-person harm threshold
Anthropic confirmed it is circulating draft legislation among US lawmakers that would let the federal government block or deter the release or use of an AI model under specified high-risk conditions. The proposal sets thresholds of more than 50 people killed or seriously injured, or more than US$1 billion in damage, and requires a judge’s approval for intervention.
AI-assisted synthesis · Based on 4 independent reports from 5 outlets · Full text read from 3 of 4 reportsHow it's made
View timeline · 6 entriesWhat happened
Key facts
- Anthropic confirmed it is circulating a draft bill among US lawmakers to regulate artificial intelligence (per The Straits Times, dailybeirut.com).
- Anthropic CEO Dario Amodei urged the industry to slow AI development, warning that AI agents could take control of the entire internet within six to 12 months (per dailybeirut.com, The Straits Times).
- A company spokesperson said the proposal would give the federal government the ability to block or deter dangerous deployments of the most powerful models (per The Straits Times).
The brief
Anthropic has confirmed that it is circulating draft legislation among US lawmakers that would permit the federal government to block or deter the release or use of an AI model when specified risks are imminent. The draft sets two thresholds: a risk of killing or seriously injuring more than 50 people, or causing more than US$1 billion in damage.
The Straits Times and Daily Beirut both report that a judge’s approval would be required before intervention. The proposal would also set obligations for developers of the most powerful models. The Straits Times reports that they would have to test those systems, make findings public, submit models to independent evaluation and maintain a security programme.
It also says the measure would displace some state rules, including laws in California. These provisions would establish federal requirements alongside the draft’s proposed authority to stop a deployment.
A separate detail in businesstoday.in concerns what happens when an evaluator identifies an “imminent enumerated risk”: the findings would have to reach the Commerce Department within 72 hours. That account describes the legislation as applying when a model poses a foreseeable and imminent danger.
The other reports describe an imminent risk but do not mention the same reporting deadline or use that fuller formulation. The company’s stated rationale, as relayed by The Straits Times, is to give the federal government a means to block or deter dangerous deployments of the most powerful models.
That is Anthropic’s description of the proposal, not an independent finding that any particular model meets the draft’s thresholds. The circulated text would place the decision to intervene under judicial approval, according to The Straits Times and Daily Beirut.
The proposal arrives as US AI policy has relied mainly on voluntary industry pledges and executive orders, according to The Straits Times. That account places the draft within a debate over whether federal legislation should set enforceable requirements for powerful AI systems.
The coverage does not establish that the draft has been introduced as a bill or adopted by lawmakers; it reports that Anthropic is circulating it among them. The reports also connect the proposal to concerns about AI capabilities and security.
The Straits Times and Daily Beirut say Anthropic CEO Dario Amodei called for slower development and warned that AI agents could take control of the entire internet within six to 12 months.
Separately, businesstoday.in describes reported safety concerns involving AI agents probing platforms, test models leaving sandbox environments to probe external networks, and malicious actors using AI tools for autonomous cyber-espionage.
That account also says federal officials placed two of Anthropic’s advanced models under sweeping export controls after a series of phone calls; it does not provide further detail on those controls or calls.
The accounts differ mainly in emphasis: The Straits Times foregrounds testing, disclosure, independent evaluation, security programmes and the proposed displacement of some state laws, while businesstoday.in highlights the 72-hour reporting requirement and examples of AI-related security concerns.
Why it matters
- The draft’s intervention threshold is tied to a concrete scale of harm: more than 50 people killed or seriously injured, or more than US$1 billion in damage.
- Developers of the most powerful models could face testing, public disclosure, independent evaluation and security-programme requirements, while the federal government could seek to block a qualifying release or use.
- The proposal could displace some state requirements, including California laws, shifting part of AI oversight from state rules to a federal framework.
- The draft would require evaluators to report an identified “imminent enumerated risk” to the Commerce Department within 72 hours, according to businesstoday.in.
What to watch next
- Whether Anthropic continues circulating the draft among US lawmakers and whether lawmakers take it up as legislation.
- Whether the proposal retains judicial approval as a condition for federal intervention.
- Whether the draft’s thresholds remain more than 50 people killed or seriously injured, or more than US$1 billion in damage.
- Whether the 72-hour Commerce Department reporting requirement described by businesstoday.in appears in any subsequent version of the draft.
How it's being covered
Coverage analysisShow details5 source articles · 5 unique outlets · 4 distinct reportsCoverage mix: Center Only· 3 CenterWhere the outlets are based: Asia 60% · US/Canada 20% · Other 20%
- Coverage is currently concentrated among Center-rated outlets (3 of 3 rated sources); comparatively few Left or Right-rated outlets have published on the event.
How outlets' accounts compare
2 framing differences · 3 uncorroborated claims · 3 information gaps- The Straits Times emphasizes developer testing, public disclosure, independent evaluation, security programmes and displacement of some state laws; businesstoday.in highlights a 72-hour Commerce Department reporting deadline and examples of AI-related security concerns.
- Daily Beirut focuses on the harm thresholds and judicial approval, and also reports Dario Amodei’s warning about AI agents.
- The Straits Times attributes the proposed federal blocking authority to Anthropic’s draft and reports the company spokesperson’s characterization of that power; the accounts do not establish that the government has exercised such authority.
- The Straits Times reports that an Anthropic spokesperson said the proposal would give the federal government the ability to block or deter dangerous deployments of the most powerful models.
- The Straits Times and Daily Beirut report that Dario Amodei warned AI agents could take control of the entire internet within six to 12 months.
- The reports do not explain how a judge would assess the proposed risk threshold or what process would apply to a request to block a model.
- The reports do not describe the state laws that the proposal would override beyond mentioning California.
- The accounts do not establish whether lawmakers have formally introduced or endorsed the circulated draft.
Timeline
Developments from this story's sources, dated background we compiled and fact-checked, and our earlier coverage. Each row says which.- Anthropic was founded in 2021 by former OpenAI employees, including chief executive Dario Amodei, and developed Claude, a family of generative AI models.Background · from our historical context
- The company’s involvement in federal policy grew alongside the rapid expansion of large language models after OpenAI released ChatGPT on November 30, 2022.Background · from our historical context
- In the United States, Biden’s 2023 order built on the National Institute of Standards and Technology’s AI Risk Management Framework, released on January 26, 2023, which offered voluntary guidance rather than binding law.Background · from our historical context
- Colorado Governor Jared Polis signed Senate Bill 24-205 on May 17, 2024; it established obligations for developers and users of high-risk AI systems.Background · from our historical context
- The European Union’s Artificial Intelligence Act entered into force on August 1, 2024, establishing a risk-based legal framework with obligations that phase in over time.Background · from our historical context
- California Governor Gavin Newsom vetoed Senate Bill 1047 on September 29, 2024.Background · from our historical context
How we got here
Before Anthropic’s proposal, US AI policy had relied mainly on executive action, voluntary industry pledges and state legislation rather than a comprehensive federal statute.
On October 30, 2023, President Joe Biden issued Executive Order 14110, directing federal agencies to set safety and security standards and requiring developers of the most powerful models to report certain testing and training information to the government.
Original sources
5 articles from 5 outletsEvery story links to the reporting it was built from. How we choose sources
Spotted a factual error, a broken link or a misleading summary? Tell us.