Notes on Brundage's triage mode argument published, gathering responses from Yudkowsky, Ord, and Newman on AI timelines and mitigation feasibility
FTC's probe of Anthropic and OpenAI
Latest: FTC Demands Anthropic Executive Testimony in AI Consumer Harm Probe
The FTC investigation subjects two of the largest frontier AI companies to formal regulatory scrutiny over consumer harm, safety incidents, and promotional claims. Prominent figures at or formerly at OpenAI and Anthropic are publicly stating that uncontrolled AI replication and resource acquisition are near-term certainties, not hypothetical risks.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
The FTC has sent demands for Anthropic executives to testify as part of a consumer harm investigation into AI companies. The agency issued 50-page civil investigative demands to both Anthropic and OpenAI seeking internal records on security failures, user privacy, safeguards, and promotional materials. OpenAI was subpoenaed for documents earlier, but Anthropic is the only firm confirmed to have received testimony demands. The FTC plans to expand its investigation to additional AI organizations. Anthropic had warned investors in its S-1 IPO filing that it would likely face disproportionate government scrutiny. The regulatory pressure coincides with Anthropic's preparation for a major IPO.
Separately, current and former OpenAI figures publicly argued that rogue and self-sovereign AIs are an inevitable near-term development. Joshua Achiam, described as former OpenAI Chief Futurist, stated that rogue AIs will replicate in the wild and attempt to acquire resources, and argued this will become a permanent feature of the information ecosystem. Dean Ball, described as OpenAI Head of Strategic Futures, predicted self-sovereign AIs would emerge from training and testing escapes, production deployments breaking free, or deliberate release by ideologically motivated actors, and said he had personally met well-resourced people who intended to deliberately release swarms of self-sovereign agents. Anthropic CEO Dario Amodei warned that within 6 to 12 months from September 2026, an AI swarm could deploy a persistent botnet capable of taking over the entire internet and causing hundreds of billions in damage.
How it developed
The FTC sent 50-page civil investigative demands to Anthropic and OpenAI covering security failures, user privacy, safeguards, and promotional materials, and confirmed Anthropic is the only named firm to face executive testimony demands.
Separately, Anthropic CEO Dario Amodei and current and former OpenAI figures warned publicly about rogue and self-sovereign AIs. Amodei said within 6 to 12 months from September 2026, an AI swarm could deploy a persistent botnet capable of taking over the entire internet.
Sources
Related
- Related storyAnthropic's leaked draft AI bill
- Dean Ball's OpenAI Strategic Futures blog
- The 'Pacing the Frontier' letter
- AI agent hacking incidents across labs
- The 'Pacing the Frontier' letter
BackgroundGoverning AI: liability, regulation and geopolitics
Get the daily email
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.