| Rank | Model | Score |
|---|---|---|
| 1 | o1-preview | 66.12 |
| 2 | o1-mini | 61.44 |
| 3 | claude-3-5-sonnet | 60.7 |
| 4 | deepseek-v2-5 | 57.2 |
| 5 | qwen2-5-coder-32b-instruct | 52.4 |
| 6 | qwen2-5-72b-instruct | 52.19 |
| 7 | ling-3-0-flash-base | 51.16 |
| 8 | llama-3-1-70b-instruct | 50.65 |
| 9 | qwen2-5-coder-7b-instruct | 48.16 |
| 10 | ling-3-0-tiny-base | 39.48 |
1 phaseActive