AI newsletter coverage of filtering study findings
AISI Studies Find Bio-AI Filtering and Code Withholding Easily Defeated
Two concrete containment strategies, filtering and code withholding, have been tested and found insufficient against low-cost effort. AISI's conclusion that training data access control looks more promising points toward a different approach to biosecurity for open biological AI.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
Two studies from the UK AI Security Institute find that common strategies for limiting dangerous biological AI capabilities have low barriers to defeat. For protein language models, filtering viral protein sequences from pretraining data reduces model performance on those sequences, but fine-tuning on the excluded data fully restores the capability across all tested model sizes. Recovering the capability in the largest tested model, at 3 billion parameters, cost approximately $80 of H100 compute. Viral protein data is routinely made publicly available even when excluded from model training, keeping the excluded data accessible. Separately, a joint study by AISI and SecureBio built a benchmark called ReproBAIT and tested whether coding agents could replicate functions of biological AI tools given only published papers and training data. Four coding agents, Claude Opus 5, GPT-5.6 Sol, Kimi K3, and Qwen3.8-2.4T, were tested in isolated sandboxes without internet access. Given a tool's description plus training data, agents matched selected metrics of two of the three tested biological AI tools but did not successfully rebuild RFdiffusion3, the most complex tool tested. Reproduction cost ranged from $4 to $20 on a single GPU. AISI concluded that withholding code does not by itself make a biological AI release safe, and that controlling access to underlying training data looks more promising.
How it developed
Audit Commons reported on AISI/SecureBio ReproBAIT findings with agent details
Coverage clarifying AISI filtering study scope (protein models, not chatbots)
Sources
- AI design of complete viral genomes
- AISI finds Claude Mythos Preview and GPT-5.5 outperform all tracked autonomous cyber capability trends
- SynthID Bio protein watermarking by Google DeepMind
- AI evaluation environment breaches across major labs
BackgroundWhen AI doesn't do what we meant
Get the daily email
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.