Anthropic publicly described the self-assessment technique and its performance
Anthropic deploys Claude self-assessment to flag misuse after each response
Self-assessment runs on every conversation, extending coverage beyond what targeted classifiers catch. Because it draws on the underlying model's judgment rather than a fixed harm taxonomy, its accuracy improves as Claude's models improve.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
Anthropic has deployed a technique called self-assessment in which Claude generates a private safety evaluation of each conversation immediately after responding. Those assessments are forwarded to Anthropic's human reviewers. The system has been in use since June 2025 and has surfaced misuse that other safeguards were not designed to catch. Because Claude has already read the full conversation when it responds, the assessment requires no extra context loading. Anthropic also operates a separate, more expensive classifier called Claude Mythos Preview that reads all safety policies before each ruling; self-assessment was trained to approximate that classifier's judgments at lower cost. On Fable 5 traffic, self-assessment matches 78% of the expensive classifier's flags overall and 94% for high-priority cases, at a 1% false-positive rate.
How it developed
Sources
- Fable 5 biology safety classifier
- Mythos 5 supply-chain attack in AISI evaluation
- Anthropic's embedded METR safety evaluation
- OpenAI's MentalHealthBench for AI evaluation
BackgroundFrontier models, open models, and how they are compared
Get the daily email
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.