Benchgen

OfficeQA Pro — Results

RankModelScore
1kimi-k363.3
O

OfficeQA Pro

1 phaseActive

Office document question-answering benchmark testing comprehension of Word, Excel, PowerPoint, and PDF files. Metric: % accuracy.

Overview

OfficeQA Pro

Category Metric Saturation Created

Quick answer: OfficeQA Pro tests a model's ability to answer questions grounded in real office documents — Word documents, Excel spreadsheets, PowerPoint presentations, and PDFs — requiring accurate extraction and reasoning over structured and semi-structured office content. Kimi K3 scores 63.3% as of July 2026.

At a Glance

What it tests: Question-answering accuracy over diverse office document formats, requiring both content extraction and reasoning across tables, slides, and formatted text.

Why it matters: Office documents are a dominant real-world data source for enterprise AI assistants. OfficeQA Pro targets this practical, high-value use case directly.

Known limitations: As an emerging benchmark, exact document sourcing and question design methodology are not yet independently published outside its citation by Moonshot AI.

What OfficeQA Pro Measures

OfficeQA Pro evaluates a model's ability to answer questions grounded in real office documents across common formats — Word, Excel, PowerPoint, and PDF. Questions require extracting and reasoning over structured elements (tables, cell references, slide content) as well as unstructured prose, testing practical document-understanding skills relevant to enterprise assistant use cases.

Benchmark Specifications

FieldValue
Task categoryReasoning / document QA
Metric% accuracy
SaturationLow
Created byNot yet independently documented

How OfficeQA Pro Is Scored

Models answer questions about the content of provided office documents, scored on % accuracy against ground-truth answers.

State-of-the-Art Results

RankModelScoreSourceDate
1Kimi K363.3%Kimi K3 technical report2026-07

Score sourced from Moonshot AI's Kimi K3 announcement, July 2026.

OfficeQA Pro on Benchgen

No Benchgen results yet — be the first to run OfficeQA Pro.

OfficeQA Pro vs Other Benchmarks

BenchmarkWhat it testsSaturation
OfficeQA ProOffice document question-answeringLow
SpreadsheetBench 2Spreadsheet-specific task completionLow
OmniDocBenchDiverse PDF document parsingLow
BIRD-SQL DevStructured data question-answering (SQL)Medium

Run OfficeQA Pro on Your Model

Benchgen lets you run OfficeQA Pro against your own model, tracking document QA accuracy across Word, Excel, PowerPoint, and PDF formats.

Frequently Asked Questions

What is OfficeQA Pro? OfficeQA Pro is a benchmark testing question-answering accuracy over real office documents — Word, Excel, PowerPoint, and PDF files.
What does a good score look like on OfficeQA Pro? Kimi K3 reports 63.3% as of July 2026, a solid result reflecting practical document comprehension across common office formats.
Who created OfficeQA Pro? OfficeQA Pro's originating team is not yet independently documented outside of its citation in Kimi K3's July 2026 technical report.