# CritPt ![Category](https://img.shields.io/badge/Category-Reasoning-1f6feb) ![Metric](https://img.shields.io/badge/Metric-%25%20Accuracy-2da44e) ![Saturation](https://img.shields.io/badge/Saturation-Low-d29922) ![Created](https://img.shields.io/badge/Created-2026-555) > **Quick answer:** CritPt is a reasoning benchmark that targets "critical points" in multi-step problems — decision junctures where careless or shallow analysis leads models astray, even if they can handle the surrounding steps correctly. Kimi K3 scores 23.4% as of July 2026, reflecting the benchmark's deliberately high difficulty. ## At a Glance **What it tests:** A model's ability to correctly navigate critical decision points within complex reasoning chains, where small analytical errors compound into wrong final answers. **Why it matters:** Aggregate accuracy on general reasoning benchmarks can mask specific failure points. CritPt isolates the moments where reasoning most commonly breaks down, providing a more diagnostic signal. **Known limitations:** As an emerging benchmark cited in Kimi K3's own technical report, independent documentation of its exact task composition and methodology is not yet widely published. ## What CritPt Measures CritPt evaluates whether a model can identify and correctly resolve critical points within multi-step reasoning tasks — junctures where a plausible but incorrect line of reasoning is especially tempting. Rather than scoring only the final answer, the design of critical-point-style benchmarks emphasizes correctness at the specific step where most reasoning failures actually occur, making low scores (like Kimi K3's 23.4%) expected even for frontier models. ## Benchmark Specifications | Field | Value | |---|---| | Task category | Reasoning | | Metric | % accuracy | | Saturation | Low | | Created by | Not yet independently documented | ## How CritPt Is Scored Models are scored on % accuracy for correctly resolving the critical reasoning point within each task, rather than partial credit for surrounding steps. ## State-of-the-Art Results | Rank | Model | Score | Source | Date | |---|---|---|---|---| | 1 | [Kimi K3](/models/moonshot/kimi-k3) | 23.4% | [Kimi K3 technical report](https://www.kimi.com/blog/kimi-k3) | 2026-07 | *Score sourced from Moonshot AI's Kimi K3 announcement, July 2026.* ## CritPt on Benchgen > No Benchgen results yet — [be the first to run CritPt](/benchmarks/platform/critpt). ## CritPt vs Other Benchmarks | Benchmark | What it tests | Saturation | |---|---|---| | **CritPt** | Critical-point reasoning accuracy | Low | | [Humanity's Last Exam](/benchmarks/center-for-ai-safety-scale-ai/humanitys-last-exam) | Frontier-hard knowledge & reasoning | Low | | [GPQA Diamond](/benchmarks/rein-et-al/gpqa-diamond) | Graduate-level science reasoning | Low | | [ARC-AGI v2](/benchmarks/chollet-et-al-arc-prize-foundation/arc-agi-v2) | Abstract reasoning | Low | ## Run CritPt on Your Model Benchgen lets you run CritPt against your own model, tracking accuracy at critical reasoning junctures to diagnose where your model's reasoning chains are most likely to break down. ## Frequently Asked Questions

What is CritPt?

CritPt is a reasoning benchmark that isolates "critical points" in multi-step problems — the specific junctures where careless analysis most commonly causes models to fail.

What does a good score look like on CritPt?

Kimi K3 reports 23.4% as of July 2026. Low absolute scores are expected given the benchmark's focus on the hardest failure points in reasoning chains.

Who created CritPt?

CritPt's originating team is not yet independently documented outside of its citation in Kimi K3's July 2026 technical report.

CritPt — Results

CritPt — Evaluations