In Factorio Space Age experiment, Astra reaches seven science packs while Fable 5.1 reaches only two
Fable 5.1 and GPT-6 Astra Launch in Same Week, Compete Across Benchmarks
Two frontier labs released their most capable models in the same week, directly competing on the same benchmarks and agentic tasks. The results show Astra leading on several hard evaluations while Fable 5.1 retains a preference among some users for coding-specific work.
The full picture
Anthropic's Fable 5.1 and OpenAI's GPT-6 Astra debuted in the same week, setting off direct comparisons across benchmarks and real-world tasks. On formal evaluations, Astra leads Fable 5.1 on FrontierMath Tier 4 (97.6% vs 87.8%), ARC-AGI-3 (62.7% on the official harness), and the Epoch AI ECI (169 vs 163). On Vending-Bench 2, a simulated autonomous business task, Astra averaged $15,515 versus Fable 5.1's $5,422, with Astra's worst run finishing above Fable's best. In a Factorio Space Age experiment, Astra reached seven science packs while Fable 5.1 reached only two. Astra is priced at $10 per million input tokens and $50 per million output tokens, which one item notes is on par with Fable 5.1. Despite Astra's benchmark leads, some users in an informal poll described by Zvi Mowshowitz still prefer Fable 5.1 for agentic coding reliability, and user preference shifted from a roughly 2:1 Claude advantage before either launch to nearly even between the two models.
How it developed
Astra averages $15,515 on Vending-Bench 2 versus Fable 5.1's $5,422, the first time OpenAI tops that leaderboard
Zvi Mowshowitz reports Astra leads Fable 5.1 on FrontierMath Tier 4, ARC-AGI-3, and Epoch ECI; user preference shifts to near-even
GPT-6 Astra and Fable 5.1 launch in the same week; Astra priced at $10/$50 per million input/output tokens, on par with Fable 5.1
Sources
- A benchmark for difficult scientific discovery from @tianqiao_chen now shows GPT-6 Astra improving across all six capabi…
- Big score by GPT-6 Astra here. it averaged $15,515 on Vending-Bench 2 bench without the collusion or failed prepayments …
- OpenAI’s release videos are getting seriously good. https://t.co/bTuLmT6cRZ https://t.co/XgFEMB3d9d
- OpenAI is rolling GPT-6 Astra out first to restricted cybersecurity customers, API access and AWS expected to follow ove…
6 more sources
Related
- Grew out ofOpenAI's Astra at the Critical cyber tier
Want this in your inbox?
I send one email each morning with the stories that moved. If you would rather just read here, that works too.
Subscribe free