MGSM — Results
| Rank | Model | Score |
|---|---|---|
| 1 | deepseek-v4-1-flash | 80.2 |
| 2 | llama-4-maverick | 0.923 |
| 3 | o3-mini | 0.92 |
| 4 | claude-3-5-sonnet | 0.916 |
| 5 | llama-3-3-70b-instruct | 0.911 |
| 6 | llama-4-scout | 0.906 |
| 7 | gpt-4o | 0.905 |
| 8 | o1 | 0.893 |
| 9 | gpt-4-turbo | 0.885 |
| 10 | gemini-1-5-pro | 0.875 |
| 11 | gpt-4o-mini | 0.87 |
| 12 | llama-3-2-90b-instruct | 0.869 |
| 13 | claude-3-5-haiku | 0.856 |
| 14 | qwen3-235b-a22b | 0.835 |
| 15 | gemini-1-5-flash | 0.826 |
| 16 | phi-4 | 0.806 |
| 17 | phi-4-mini | 0.639 |
| 18 | phi-3-5-moe-instruct | 0.587 |
| 19 | llama-3-2-3b-instruct | 0.582 |
| 20 | phi-3-5-mini-instruct | 0.479 |
MGSM — Phases
1 phaseActive
Phase 1·
MGSM
Aug 3, 2026
Current