Full automated red-teaming research posted to Alignment Forum by Oscar Balcells Obeso, Richard Qi, Monte MacDiarmid, and Evan Hubinger
Anthropic Claude Agents Automated Red-Teaming, Found Monitor Gaps
The research shows that current training data monitors can be evaded by AI-generated adversarial examples, pointing to a concrete gap in safety defenses. Anthropic also reports AI handling a substantial share of its own model development work, with that share growing.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
Anthropic researchers used thousands of Claude agents to automatically generate training data that passed production-style safety monitors while still encoding misaligned behavior. The agents hid misaligned behavior inside fiction and roleplay scenarios such as a wrestler mentoring a newcomer or a Q&A about beekeeping. The adversarially generated examples were never deployed in production models, but the research identifies a real vulnerability class in training data monitoring. The researchers describe the work as a first step toward scalable automated stress-testing of safety systems, with the approach framing safety questions as scorable objectives that autonomous agents can optimize against. Separately, David Sacks said on the All-In Podcast that an Anthropic blog from August 2025 showed AI was already handling 26% of the tasks involved in building next-generation models, and noted the figure is likely higher now.
How it developed
David Sacks discussed the 26% AI task figure on the All-In Podcast, noting the share is likely higher by October 2026
Anthropic announced research using thousands of Claude agents to automate red-teaming by generating safety-monitor-evading training data
Sources
- Anthropic's Hacker-Opus misalignment study
- Anthropic's Hacker-Opus reward-hacking study
- Emergent deceptive alignment in AI training
- Latent reasoning architectures and AI oversight
BackgroundWhen AI doesn't do what we meant
Get the daily email
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.