| Rank | Model | Score |
|---|---|---|
| 1 | gpt-5-6-sol | 99.9 |
| 2 | glm-5-2 | 99.2 |
| 3 | gemini-3-1-pro | 98.3 |
| 4 | inkling | 97.1 |
| 5 | deepseek-v4-pro | 96.7 |
| 6 | namazu | 96.67 |
| 7 | kimi-k2-6 | 96.4 |
| 8 | kimi-k2-5 | 95.8 |
| 9 | qwen3-6-plus | 95.3 |
| 10 | solar-pro-4 | 95.3 |
| 11 | muse-glimmer | 94.7 |
| 12 | nemotron-3-ultra-550b-a55b | 94.2 |
| 13 | qwen3-6-27b | 94.1 |
| 14 | qwen3-6-35b-a3b | 92.7 |
| 15 | qwen3-5-397b-a17b | 91.3 |
| 16 | maple-preview | 87.5 |
1 phaseActive
Competition math benchmark — 30 problems from AIME I & II 2026, integer answers 0–999. Tests frontier model mathematical reasoning. Metric: % correct (pass@1).
Quick answer: AIME 2026 is an AI evaluation benchmark built from the 30 problems of the 2026 American Invitational Mathematics Examination (15 problems from AIME I, administered February 5 2026, and 15 from AIME II). It tests frontier model mathematical reasoning at competition level — problems require algebra, combinatorics, number theory, and geometry, with integer answers in the range 000–999. GLM 5.2 leads the Inkling comparison set at 99.2%.
What it tests: Multi-step mathematical reasoning across algebra, combinatorics, number theory, geometry, and probability at the high-school olympiad level. Problems require deriving a specific integer answer (000–999), preventing partial credit or lucky guessing.
Why it matters: AIME sits above AMC 10/12 but below USAMO in difficulty — it is the most widely-used intermediate competition math benchmark for AI evaluation. Every problem requires a non-trivial derivation chain, making it a reliable signal for genuine mathematical reasoning rather than pattern matching to memorised solutions.
Known limitations: 30 problems is a small evaluation set, making scores high-variance (each problem is worth ~3.3%). Since AIME 2026 problems are publicly available, results for models trained after February 2026 carry contamination risk — scores may reflect memorised solutions rather than reasoning. Models from labs that explicitly test on the full problem set (not a held-out split) should be compared cautiously.
The American Invitational Mathematics Examination is an annual U.S. high-school mathematics competition administered by the Mathematical Association of America (MAA). Students who qualify via the AMC 10 or AMC 12 sit a 3-hour, 15-problem exam; answers are integers from 000 to 999, with no multiple-choice options. AIME 2026 ran in two versions: AIME I (February 5, 2026) and AIME II, each with 15 problems of escalating difficulty.
For AI evaluation, the standard protocol is to run each model on all 30 problems (both AIME I and AIME II) and report the pass@1 accuracy — the percentage of problems where the model's first attempt produces the correct integer answer. Some labs also report pass@k (majority vote over multiple samples). Scores in the Inkling table are pass@1 at effort=0.99.
Problem categories broadly cover: algebra and polynomials, combinatorics and counting, number theory and modular arithmetic, Euclidean and coordinate geometry, and probability. Problems are self-contained and do not require specialised knowledge beyond pre-calculus.
| Field | Value |
|---|---|
| Task category | Mathematical reasoning |
| Metric | % correct (pass@1, integer answer matching) |
| Number of problems | 30 (15 × AIME I + 15 × AIME II) |
| Answer range | Integer 000–999 |
| Administered | February 2026 |
| Difficulty | High-school olympiad (post-AMC, pre-USAMO) |
| Saturation | Low |
| Created by | Mathematical Association of America (MAA) |
| Source | Art of Problem Solving AIME archive |
A model is prompted with each problem statement and asked to produce an integer answer. The answer is graded as correct if it exactly matches the official answer key (000–999). Scores are reported as % of 30 problems correct (pass@1). Chain-of-thought reasoning is standard; temperature 0 or majority-vote sampling is common. Some evaluations allow tool use (e.g. Python code execution for computation); the Inkling results are at effort=0.99 with no external tools specified.
Scores from Inkling model card (Thinking Machines Lab, July 2026), evaluated at effort=0.99. Claude Fable 5 score not reported in source table.
| Rank | Model | Score | Weights |
|---|---|---|---|
| 1 | GLM 5.2 | 99.2% | Open |
| 2 | GPT-5.6 Sol | 99.9% | Closed |
| 3 | Gemini 3.1 Pro | 98.3% | Closed |
| 4 | Inkling | 97.1% | Open |
| 5 | DeepSeek V4 Pro | 96.7% | Open |
| 6 | Kimi K2.6 | 96.4% | Open |
| 7 | Kimi K2.5 | 95.8% | Open |
| 8 | Nemotron 3 Ultra | 94.2% | Open |
Frontier model scores above 94% reflect near-saturation — the benchmark has limited discriminative power at the very top of the leaderboard as of mid-2026.
| Benchmark | Problems | Format | Difficulty | Saturation |
|---|---|---|---|---|
| AIME 2026 | 30 | Integer answer | High-school olympiad | Low |
| AMC 10/12 | 30 | 5-choice MCQ | High-school competition | High |
| Humanity's Last Exam | ~3,000 | Mixed | PhD+ level | Low |
| GPQA Diamond | 198 | 4-choice MCQ | PhD science | Low |
| MATH-500 | 500 | Free-form | Competition math | Medium |
Last updated 2026-07-16.