# DeepSearchQA ![Category](https://img.shields.io/badge/Category-Deep%20Research%20Agent-1f6feb) ![Metric](https://img.shields.io/badge/Metric-F1-2da44e) ![Saturation](https://img.shields.io/badge/Saturation-Low-d29922) ![Created](https://img.shields.io/badge/Created-2026-555) > **Quick answer:** DeepSearchQA is a deep-research agent benchmark that tests an AI system's ability to conduct multi-hop web search, synthesize information across sources, and produce accurate, well-supported answers to complex questions. Results are reported as an F1 score. Kimi K3 scores 95.0 F1 as of July 2026. ## At a Glance **What it tests:** An agent's ability to plan and execute multi-step web research — issuing search queries, evaluating source reliability, and synthesizing a final accurate answer. **Why it matters:** As "deep research" agent products become common, DeepSearchQA offers a task-specific way to measure real research quality rather than static knowledge recall. **Known limitations:** As an emerging benchmark, methodology details (e.g., exact search tool access, source pool) are not yet independently documented outside its citation by Moonshot AI. ## What DeepSearchQA Measures DeepSearchQA evaluates an AI agent's deep-research capability: given a complex question, the agent must plan and execute multi-hop web searches, evaluate and cross-reference retrieved sources, and synthesize a final answer supported by evidence. Unlike static QA benchmarks, this requires active tool use (web search) combined with reasoning over retrieved content. ## Benchmark Specifications | Field | Value | |---|---| | Task category | Agent / deep research | | Metric | F1 score | | Saturation | Low | | Created by | Not yet independently documented | ## How DeepSearchQA Is Scored Agent-produced answers are compared against reference answers, with correctness scored via F1 (balancing precision and recall of the answer's key facts), reflecting both accuracy and completeness of the synthesized response. ## State-of-the-Art Results | Rank | Model | Score | Source | Date | |---|---|---|---|---| | 1 | [Kimi K3](/models/moonshot/kimi-k3) | 95.0 F1 | [Kimi K3 technical report](https://www.kimi.com/blog/kimi-k3) | 2026-07 | *Score sourced from Moonshot AI's Kimi K3 announcement, July 2026.* ## DeepSearchQA on Benchgen > No Benchgen results yet — [be the first to run DeepSearchQA](/benchmarks/platform/deepsearchqa). ## DeepSearchQA vs Other Benchmarks | Benchmark | What it tests | Saturation | |---|---|---| | **DeepSearchQA** | Multi-hop web research & synthesis | Low | | [ResearchRubrics](/benchmarks/platform/researchrubrics) | Rubric-graded research report quality | Low | | [SimpleQA](/benchmarks/openai/simpleqa) | Short-form factual QA | High | | [BrowseComp](/benchmarks/openai/browsecomp) | Complex web-browsing agent tasks | Low | ## Run DeepSearchQA on Your Model Benchgen lets you run DeepSearchQA against your own model and search harness, tracking F1 performance over time to validate deep-research agent deployments. ## Frequently Asked Questions

What is DeepSearchQA?

DeepSearchQA is a deep-research agent benchmark testing multi-hop web search, source synthesis, and answer accuracy, scored via F1.

What does a good score look like on DeepSearchQA?

Kimi K3 reports 95.0 F1 as of July 2026, a strong result indicating high precision and recall in synthesizing research answers.

Who created DeepSearchQA?

DeepSearchQA's originating team is not yet independently documented outside of its citation in Kimi K3's July 2026 technical report.

Rank	Model	Score
1	kimi-k3	95
2	muse-glimmer	74.6

DeepSearchQA — Results

DeepSearchQA — Evaluations