OCRBench — Results
| Rank | Model | Score |
|---|---|---|
| 1 | north-micro-vision-instruct | 79.2 |
OCRBench
1 phaseActive
OCR-focused multimodal benchmark spanning text recognition, scene-text VQA, handwriting, and mathematical expression recognition.
Overview
OCRBench
Quick answer: OCRBench (Liu et al., 2023) is a comprehensive benchmark for OCR-related capabilities of large multimodal models, spanning text recognition, scene-text VQA, document VQA, handwritten mathematical expression recognition, and key information extraction across roughly 1,000 question-answer pairs. North Micro Vision scores 79.2% as of August 2026.
At a Glance
What it tests: Five OCR-centric capability groups — text recognition, scene-text-centric VQA, document-oriented VQA, key information extraction, and handwritten mathematical expression recognition.
Why it matters: OCR was one of the first capabilities shown to be surprisingly weak in early large multimodal models despite strong general VQA performance; OCRBench was built specifically to surface and track this gap.
Known limitations: As one of the earlier dedicated OCR benchmarks, it is now showing medium saturation among leading multimodal models, motivating the harder, larger-scale OCRBench v2 follow-up.
What OCRBench Measures
OCRBench assembles roughly 1,000 question-answer pairs across five OCR-related capability groups: plain text recognition, scene-text VQA (reading text embedded in natural photos), document-oriented VQA, key information extraction (e.g. pulling structured fields from receipts or forms), and handwritten mathematical expression recognition.
The benchmark's authors found that even multimodal LLMs performing well on general VQA benchmarks often struggled significantly with precise text recognition and extraction — motivating a benchmark that isolates OCR capability from broader visual reasoning.
OCRBench remains a widely-reported OCR sanity check, though its narrower five-task-group scope and smaller question count (relative to the newer, larger OCRBench v2) means it now discriminates less sharply among the strongest current models.
Benchmark Specifications
| Field | Value |
|---|---|
| Task category | Reasoning (OCR) |
| Metric | % accuracy (normalized; original scale 0-1000) |
| Number of tasks | ~1,000 |
| Saturation | Medium |
| Created by | Liu et al. |
| Source paper | Liu et al. 2023 |
| GitHub | Yuliang-Liu/MultimodalOCR |
| Dataset | echo840/OCRBench on HuggingFace |
How OCRBench Is Scored
Each of the ~1,000 items across the five capability groups is scored for correctness; results are commonly reported on a 0-1000 raw point scale or normalized to a 0-100% accuracy scale, summed/averaged across all five task groups.
State-of-the-Art Results
| Rank | Model | Score | Source | Date |
|---|---|---|---|---|
| 1 | North Micro Vision Instruct | 79.2% | North Micro Vision launch blog | 2026-08 |
Score sourced from Cohere Labs' North Micro Vision Instruct launch announcement, August 2026.
OCRBench on Benchgen
No Benchgen results yet — be the first to run OCRBench.
OCRBench vs Other Benchmarks
| Benchmark | What it tests | Saturation |
|---|---|---|
| OCRBench | Five OCR capability groups: recognition, scene/doc VQA, KIE, handwriting | Medium |
| OCRBench v2 | Larger-scale, harder OCR benchmark with text localization and reasoning | Low |
| DocVQA | Scanned/plain-text document question answering | High |
OCRBench remains a useful, widely-adopted OCR baseline, but OCRBench v2's larger and more difficult task set is the better choice for differentiating among today's strongest OCR-capable models.
Run OCRBench on Your Model
Benchgen lets you evaluate your own vision-language model's OCR capabilities across text recognition, scene/document VQA, and handwriting recognition, and track results across model versions.
Related Models & Benchmarks
- Top performers: North Micro Vision Instruct
- Related benchmarks: OCRBench v2 · DocVQA