Benchgen

HumanEval — Results

RankModelScore
1twil-8b93.2
2deepseek-v4-1-flash79.4
3minicpm-sala0.951
4kimi-k2-09050.945
5gpt-5-10.94
6claude-3-5-sonnet0.937
7gpt-5-20.936
8gpt-50.934
9gpt-50.934
10kimi-k2-instruct0.933
11kimi-k2-instruct0.933
12qwen2-5-coder-32b-instruct0.927
13qwen2-5-coder-32b-instruct0.926
14sarvam-30b0.921
15claude-3-5-sonnet-v10.92
16mistral-large-20.92
17deepseek-v3-20.92
18qwen2-5-vl-32b-instruct0.915
19gpt-4o0.902
20gemini-2-5-pro0.9
21deepseek-v3-10.898
22granite-3-3-8b-base0.897
23granite-3-3-8b-instruct0.897
24nova-2-pro0.89
25llama-3-1-405b-instruct0.89
H

HumanEval — Leaderboard

1 phaseActive

HumanEval Leaderboard

No self-reported entries.