# AA-Briefcase ![Category](https://img.shields.io/badge/Category-Knowledge%20Work%20Agent-1f6feb) ![Metric](https://img.shields.io/badge/Metric-Elo-2da44e) ![Saturation](https://img.shields.io/badge/Saturation-Low-d29922) ![Created](https://img.shields.io/badge/Created-2026-555) [![Website](https://img.shields.io/badge/Website-artificialanalysis.ai-0969da)](https://artificialanalysis.ai) > **Quick answer:** AA-Briefcase is an Elo-rated benchmark from Artificial Analysis that evaluates AI agents on professional knowledge-work deliverables — the kind of documents, analyses, and reports a professional would carry in a briefcase. Human or model raters compare pairwise outputs to derive a relative Elo rating. Kimi K3 scores 1548 Elo as of July 2026. ## At a Glance **What it tests:** The quality of AI-generated professional knowledge-work outputs (reports, analyses, documents), rated via pairwise comparison rather than binary pass/fail. **Why it matters:** Many knowledge-work tasks don't have a single "correct" answer, making Elo-style pairwise comparison a better fit than accuracy scoring. AA-Briefcase, from independent evaluator Artificial Analysis, provides a comparable cross-model quality signal. **Known limitations:** Elo scores are relative to the pool of models being compared and the specific rating methodology, so they should not be interpreted as absolute accuracy percentages. ## What AA-Briefcase Measures AA-Briefcase evaluates the quality of professional knowledge-work deliverables generated by AI models — such as written reports, analyses, and business documents — using pairwise comparison judged by human or model raters. Results are aggregated into an Elo rating, similar to the methodology Artificial Analysis uses across its broader intelligence benchmarking suite (e.g., GDPval-AA). ## Benchmark Specifications | Field | Value | |---|---| | Task category | Agent / knowledge work | | Metric | Elo rating | | Saturation | Low | | Created by | Artificial Analysis | | Website | [artificialanalysis.ai](https://artificialanalysis.ai) | ## How AA-Briefcase Is Scored Model outputs on professional knowledge-work tasks are compared pairwise against outputs from other models, and results are aggregated into a relative Elo rating — higher Elo indicates outputs that are more consistently preferred in head-to-head comparison. ## State-of-the-Art Results | Rank | Model | Score | Source | Date | |---|---|---|---|---| | 1 | [Kimi K3](/models/moonshot/kimi-k3) | 1548 Elo | [Kimi K3 technical report](https://www.kimi.com/blog/kimi-k3) | 2026-07 | *Score sourced from Moonshot AI's Kimi K3 announcement, July 2026.* ## AA-Briefcase on Benchgen > No Benchgen results yet — [be the first to run AA-Briefcase](/benchmarks/artificial-analysis/aa-briefcase). ## AA-Briefcase vs Other Benchmarks | Benchmark | What it tests | Metric | |---|---|---| | **AA-Briefcase** | Professional knowledge-work deliverable quality | Elo | | [GDPval-AA v2](/benchmarks/artificial-analysis/gdpval-aa-v2) | Economically valuable task performance | Elo | | [Agents' Last Exam](/benchmarks/berkeley/agents-last-exam) | Economically valuable long-horizon agent tasks | Pass rate | | [Harvey Lab-AA](/benchmarks/platform/harvey-lab-aa) | Legal knowledge-work quality | % accuracy | ## Run AA-Briefcase on Your Model Benchgen lets you track AA-Briefcase-style Elo comparisons for your own model's knowledge-work outputs over time, alongside your other benchmark results. ## Frequently Asked Questions

What is AA-Briefcase?

AA-Briefcase is an Elo-rated benchmark from Artificial Analysis that evaluates the quality of AI-generated professional knowledge-work deliverables via pairwise comparison.

What does a good score look like on AA-Briefcase?

Kimi K3 reports 1548 Elo as of July 2026. As with any Elo system, scores are meaningful relative to other models in the same rating pool rather than as an absolute percentage.

Who created AA-Briefcase?

AA-Briefcase is created and maintained by Artificial Analysis, an independent AI model evaluation and analysis platform.

AA-Briefcase — Results

AA-Briefcase — Phases

AA-Briefcase