# FrontierCode ![Category](https://img.shields.io/badge/Category-Coding%20Agent-1f6feb) ![Metric](https://img.shields.io/badge/Metric-%25%20Score-2da44e) ![Tasks](https://img.shields.io/badge/Tasks-100-8957e5) ![Saturation](https://img.shields.io/badge/Saturation-Low-d29922) ![Created](https://img.shields.io/badge/Created-2026-555) [![Leaderboard](https://img.shields.io/badge/Leaderboard-Cognition-0969da)](https://cognition.com/frontiercode) > **Quick answer:** FrontierCode is Cognition's coding agent benchmark that scores agentic coding runs using a rubric-weighted system gated by blocking criteria, rather than simple pass/fail — it publishes a 100-task Main subset and a 150-task Extended subset (a prior 50-task Diamond subset was deprecated in v1.1). Grok 4.6 scores 61.3% on the Extended subset as of August 2026. ## At a Glance **What it tests:** Whether a coding agent produces a working, correctly-scoped solution to a realistic engineering task, judged against a weighted rubric where certain "blocking" criteria must pass before partial credit counts. **Why it matters:** The rubric-weighted, blocking-criteria design more closely mirrors how a human engineer reviews a pull request than a binary pass/fail test suite, making FrontierCode a signal for production-readiness rather than just raw problem-solving. **Known limitations:** As a v1.1 benchmark from a single lab (Cognition), methodology transparency and independent replication are more limited than academic benchmarks like SWE-Bench. ## What FrontierCode Measures FrontierCode is developed by Cognition (maker of the Devin coding agent) to evaluate agentic coding models on realistic software engineering tasks. Unlike simple test-pass benchmarks, FrontierCode grades each submission against a weighted rubric: certain "blocking" criteria (e.g., the change must not break existing functionality) gate whether the submission can receive any credit at all, after which partial credit is awarded across secondary rubric items. The benchmark ships in two published subsets — **Main** (100 tasks) and **Extended** (150 tasks) — with a legacy 50-task **Diamond** subset deprecated as of v1.1. ## Benchmark Specifications | Field | Value | |---|---| | Task category | Coding agent | | Metric | % score (rubric-weighted, blocking-criteria-gated) | | Number of tasks | 100 (Main) / 150 (Extended) | | Saturation | Low | | Created by | Cognition | | Project | [cognition.com/frontiercode](https://cognition.com/frontiercode) | ## How FrontierCode Is Scored Each task submission is graded against a rubric with blocking criteria that must be satisfied before any partial credit is awarded; the final score is a weighted percentage across all rubric items for all tasks in the chosen subset (Main or Extended). ## State-of-the-Art Results | Rank | Model | Score | Subset | Source | Date | |---|---|---|---|---|---| | 1 | [Grok 4.6](/models/xai/grok-4-6) | 61.3% | Extended | [xAI Grok 4.6 announcement](https://x.ai/news/grok-4-6) | 2026-08 | *Score sourced from xAI's Grok 4.6 announcement, August 2026, reporting the Extended subset. Cognition's own leaderboard reports Main-subset scores separately at [cognition.com/frontiercode](https://cognition.com/frontiercode); scores across subsets are not directly comparable.* ## FrontierCode on Benchgen > No Benchgen results yet — [be the first to run FrontierCode](/benchmarks/cognition/frontiercode). ## FrontierCode vs Other Benchmarks | Benchmark | What it tests | Tasks | Saturation | |---|---|---|---| | **FrontierCode** | Rubric-weighted, blocking-gated coding agent tasks | 100–150 | Low | | [DeepSWE](/benchmarks/datacurve/deepswe) | Real-world software engineering agent tasks | — | Low | | [APEX-SWE](/benchmarks/mercor/apex-swe) | Pass@1 software engineering agent tasks | 200 | Low | ## Run FrontierCode on Your Model Benchgen lets teams run FrontierCode-style rubric evaluations against their own model and harness combinations, tracking regressions across versions rather than relying on a single vendor-reported number. ## Frequently Asked Questions

What is FrontierCode?

FrontierCode is Cognition's coding agent benchmark that grades submissions against a weighted rubric gated by blocking criteria, published in Main (100-task) and Extended (150-task) subsets.

What does a good score look like on FrontierCode?

Grok 4.6 reports 61.3% on the Extended subset as of August 2026; scores vary meaningfully between the Main and Extended subsets, so always check which is being cited.

Who created FrontierCode?

FrontierCode is created and maintained by Cognition, the company behind the Devin coding agent.

Why was the Diamond subset deprecated?

Cognition deprecated the original 50-task Diamond subset as of FrontierCode v1.1 in favor of the larger Main and Extended subsets.

FrontierCode — Results

FrontierCode — Evaluations