A Stanford study of 8 LLMs judging 620 medical questions found every model favored its own anonymous answers by 1.22 rank positions on average, with GPT-5.6 Sol showing nearly 3 rank positions of bias.
Revealing model names reduced the effect by only 0.094 positions. A Chatbot Arena analysis of 1,260,967 blind votes found 'both are bad' votes rising 1.71 percentage points per month from a 17.1% baseline, though relative rankings held stable. Anthropic published ten recommendations for designing and reporting safety evaluations.