The Information Machine
Following·Day 2·2 sources

Cammarata Reverses Pessimism: Most Neurons in Large Models Legible

The gist

Mechanistic interpretability is a core method for understanding what neural networks are actually doing, with direct bearing on AI alignment research. A shift from 2% legibility to a large majority changes the practical outlook for that research program.

The full picture

Nick Cammarata, who co-authored early mechanistic interpretability research at OpenAI, has reversed his earlier pessimism about the field. Where a large-scale automated interpretability project at OpenAI once found only about 2% of neurons legible using primitive tools, Cammarata now says the vast majority of neurons in models up to trillions of parameters are legible and their circuits comprehensible. He attributes the earlier pessimism partly to misunderstanding: many neurons previously cited as tangled or uninterpretable turned out not to be genuinely illegible. Using modern agentic tools and closer examination, the picture has changed substantially. Cammarata now believes ambitious interpretability will be solved before it is critically needed, and potentially soon as automated scientific tools continue to improve.

How it developed
16 October 2026

Sam Altman responds positively; Dean Ball publishes Hyperdimensional podcast episode on the essay

15 October 2026

Cammarata's findings on neuron legibility and reversal of interpretability pessimism announced; Dean Ball reacts

Sources
The daily email

Want this in your inbox?

I send one email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free