OpenAI's Codex agent performance investigation system
- OpenAI described a system called the Performance Factory, which uses Codex-powered agents to automatically investigate ChatGPT performance slowdowns, with one agent diagnosing a cause from logs and recent code changes, a second attempting to disprove that diagnosis, and a third proposing a fix for human review.
- Operational figures released the following day show the system runs about 17 investigations per day at 70% diagnostic accuracy, but out of 600-plus diagnosed problems only about 15 agent-proposed fixes shipped unchanged.
- OpenAI identified fix generation as the weak point compared to diagnosis.
The system shows AI agents can handle a substantial share of automated diagnosis in production infrastructure, while also illustrating a sharp gap between diagnosis accuracy and the ability to generate shippable fixes.