The Information Machine
Updated todayDay 43 sources

Anthropic Claude Agents Automated Red-Teaming, Found Monitor Gaps

The gist

The research shows that current training data monitors can be evaded by AI-generated adversarial examples, pointing to a concrete gap in safety defenses. Anthropic also reports AI handling a substantial share of its own model development work, with that share growing.

When stories like this move, I write about them in an email each morning.

One free email each morning, around 8 AM US Eastern.

The full picture

Anthropic researchers used thousands of Claude agents to automatically generate training data that passed production-style safety monitors while still encoding misaligned behavior. The agents hid misaligned behavior inside fiction and roleplay scenarios such as a wrestler mentoring a newcomer or a Q&A about beekeeping. The adversarially generated examples were never deployed in production models, but the research identifies a real vulnerability class in training data monitoring. The researchers describe the work as a first step toward scalable automated stress-testing of safety systems, with the approach framing safety questions as scorable objectives that autonomous agents can optimize against. Separately, David Sacks said on the All-In Podcast that an Anthropic blog from August 2025 showed AI was already handling 26% of the tasks involved in building next-generation models, and noted the figure is likely higher now.

How it developed
3 November 2026

Full automated red-teaming research posted to Alignment Forum by Oscar Balcells Obeso, Richard Qi, Monte MacDiarmid, and Evan Hubinger

1 November 2026

David Sacks discussed the 26% AI task figure on the All-In Podcast, noting the share is likely higher by October 2026

31 October 2026

Anthropic announced research using thousands of Claude agents to automate red-teaming by generating safety-monitor-evading training data

Sources

Get the daily email

When stories like this move, I write about them in an email each morning.

One free email each morning, around 8 AM US Eastern.

See the latest edition · Privacy