Bird-SQL (dev) — Results
| Rank | Model | Score |
|---|---|---|
| 1 | gemini-2-0-flash-lite | 0.574 |
| 2 | gemini-2-0-flash | 0.569 |
| 3 | gemma-3-27b | 0.544 |
| 4 | gemma-3-12b | 0.479 |
| 5 | nemotron-3-super-120b-a12b | 0.418 |
| 6 | gemma-3-4b | 0.363 |
| 7 | gemma-3-1b | 0.064 |
B
Bird-SQL (dev)
1 phaseActive
Comprehensive text-to-SQL benchmark with 12,751 question-SQL pairs across 95 databases spanning 37+ professional domains.
Overview
Bird-SQL (dev)
Quick answer: BIRD (BIg Bench for LaRge-scale Database Grounded Text-to-SQLs) is a comprehensive text-to-SQL benchmark with 12,751 question-SQL pairs across 95 databases (33.4 GB) spanning 37+ professional domains including healthcare, finance, and sports.
Benchmark Details
| Property | Value |
|---|---|
| Tasks | 12,751 question-SQL pairs |
| Databases | 95 databases, 33.4 GB total |
| Domains | 37+ professional domains |
| Metric | Execution accuracy |
| Challenges | Complex schemas, dirty data, domain knowledge |
Source: Li et al. 2023. Last updated 2026-07-24.