SWE-bench Pro — Results
| Rank | Model | Score |
|---|---|---|
| 1 | flint | 89.7 |
| 2 | fugu-ultra | 73.7 |
| 3 | qwen3-8-max | 67.7 |
| 4 | beam-1-0-501b-a23b | 66.1 |
| 5 | hy4-preview | 65.7 |
| 6 | nex-n2-5-max | 65.7 |
| 7 | ornith-1-5-397b | 65.1 |
| 8 | gpt-5-6-sol | 64.6 |
| 9 | claude-opus-4-7 | 64.3 |
| 10 | gpt-5-6-terra | 63.4 |
| 11 | claude-sonnet-5 | 63.2 |
| 12 | gpt-5-6-luna | 62.7 |
| 13 | qwen3-8-flash-next | 62.5 |
| 14 | glm-5-2 | 62.1 |
| 15 | qwen3-8-27b | 61.7 |
| 16 | nex-n2-5-pro | 61.2 |
| 17 | sage-a1-5 | 61.2 |
| 18 | dots3-note-preview | 61 |
| 19 | nanbeige4-3-33b | 60.3 |
| 20 | ornith-1-5-35b-a3b | 59.6 |
| 21 | laguna-s-2-1 | 59.4 |
| 22 | fugu | 59 |
| 23 | gpt-5-5 | 58.6 |
| 24 | kimi-k2-6 | 58.6 |
| 25 | claude-sonnet-4-6 | 58.1 |
SWE-bench Pro — Evaluations
1 phaseActive
No evaluations yet for this benchmark.