'The Leaderboard Illusion' paper critiques Chatbot Arena methodology
Researchers found Meta tested roughly 27 private Llama variants before its public release and that OpenAI and Google alone received about 40% of all Arena battle data.
Benchmarks & progress