MBPP — Results

Rank	Model	Score
1	twil-8b	93.7
2	llama-3-3-nemotron-super-49b-v1	0.913
3	qwen2-5-coder-32b-instruct	0.902
4	qwen2-5-72b-instruct	0.882
5	qwen2-5-32b-instruct	0.84
6	qwen2-5-vl-32b-instruct	0.84
7	qwen2-5-coder-7b-instruct	0.835
8	qwen2-5-14b-instruct	0.82
9	qwen3-235b-a22b	0.814
10	phi-3-5-moe-instruct	0.808
11	qwen2-72b-instruct	0.802
12	qwen2-5-7b-instruct	0.792
13	llama-4-maverick	0.776
14	mistral-small-3-1-24b-instruct	0.747
15	qwen2-5-omni-7b	0.732
16	mistral-small-3-24b-base	0.696
17	phi-3-5-mini-instruct	0.696
18	llama-4-scout	0.678
19	qwen2-7b-instruct	0.672

MBPP — Phases

1 phaseActive

Phase 1·

MBPP

Aug 3, 2026

Current