Quick answer: Mistral Small 4 is Mistral AI's September 2025 Small tier model scoring 78% MMLU-Pro and 58.3% Arena Hard. Proprietary — Mistral Small generation 4.
Where Mistral Small 4 leads
Where it lags
Best for: MMLU-Pro knowledge tasks via Mistral API; Small-tier budget.
Mistral Small 4 is the September 2025 update to the Mistral Small series. MMLU-Pro jumps from 66.3% (Small 3) to 78%, while Arena Hard drops from 87.6% to 58.3%.
| Field | Value |
|---|---|
| Organization | Mistral AI |
| License | Mistral Small 4 License |
| Release date | September 2025 |
| Modality | Text only |
Available via Mistral AI API.
| Benchmark | Score | Source | Date |
|---|---|---|---|
| MMLU-Pro | 78% | Benchgen evaluation | 2025-09 |
| Arena Hard | 58.3% | Benchgen evaluation | 2025-09 |
| Model | MMLU-Pro | Arena Hard | License |
|---|---|---|---|
| Mistral Small 4 | 78% | 58.3% | Proprietary |
| Mistral Small 3.2 24B | — | — | Apache 2.0 |
Mistral Small 3 (87.6% Arena Hard, Apache 2.0) likely better for instruction tasks. Small 4 only for MMLU-Pro with latest API.
Specs from Mistral AI's Mistral Small 4 release (September 2025) and Benchgen evaluations. Last updated 2026-07-24.
This model isn’t on any benchmark leaderboard yet.