MBPP — Results
| Rank | Model | Score |
|---|---|---|
| 1 | llama-3-3-nemotron-super-49b-v1 | 0.913 |
| 2 | qwen2-5-coder-32b-instruct | 0.902 |
| 3 | qwen2-5-72b-instruct | 0.882 |
| 4 | qwen2-5-32b-instruct | 0.84 |
| 5 | qwen2-5-vl-32b-instruct | 0.84 |
| 6 | qwen2-5-coder-7b-instruct | 0.835 |
| 7 | qwen2-5-14b-instruct | 0.82 |
| 8 | qwen3-235b-a22b | 0.814 |
| 9 | phi-3-5-moe-instruct | 0.808 |
| 10 | qwen2-72b-instruct | 0.802 |
| 11 | qwen2-5-7b-instruct | 0.792 |
| 12 | llama-4-maverick | 0.776 |
| 13 | mistral-small-3-1-24b-instruct | 0.747 |
| 14 | qwen2-5-omni-7b | 0.732 |
| 15 | mistral-small-3-24b-base | 0.696 |
| 16 | phi-3-5-mini-instruct | 0.696 |
| 17 | llama-4-scout | 0.678 |
| 18 | qwen2-7b-instruct | 0.672 |
MBPP — Evaluations
1 phaseActive
No evaluations yet for this benchmark.