MathVista

Word problems are easy to make harder by taking away the words. MathVista, built by researchers at UCLA, the University of Washington and Microsoft Research, tests mathematical reasoning that depends on reading a picture first — a plotted function, a geometry diagram, a bar chart, a logic-puzzle figure — and only then doing the arithmetic or algebra the picture implies. The benchmark pools 6,141 examples from 28 existing maths-and-vision datasets plus three tasks the authors built themselves to cover gaps: puzzle figures, function plots and academic-paper diagrams.

At launch in October 2023, the gap between models and people was stark. GPT-4V, the best of twelve systems tested, scored 49.9%, comfortably ahead of Google’s Bard but still 10.4 points short of the 60.3% human baseline the authors measured. That gap closed fast: Claude 3.5 Sonnet reported 67.7% in June 2024, already above the original human baseline, and by February 2025 Alibaba’s Qwen2.5-VL-72B reported 74.8% on the same “testmini” subset, ahead of GPT-4o and Claude 3.5 Sonnet on the same comparison table in its own technical report.

Unlike some contemporaries, MathVista has not been superseded by a discrete “Pro” successor, but it has faded somewhat from frontier labs’ own headline evaluation reports; Google’s Gemini 3 Pro evaluation document from November 2025, for instance, reports a different, newer slate of multimodal and reasoning benchmarks and does not include a MathVista figure. Whether a specific 2025–26 frontier model has since posted a higher, independently sourced MathVista score than Qwen2.5-VL-72B’s 74.8% was not confirmed for this entry.