Benchgen

CorpFin v2 — Results

RankModelScore
1claude-opus-573.2
2claude-opus-573.2
3claude-fable-571.8
4claude-fable-571.8
5kimi-k371.6
6muse-spark-1-270.9
7muse-spark-1-270.9
C

CorpFin v2

1 phaseActive

Vals AI private benchmark on understanding long-context credit agreements: 858 test questions from 43 documents. Archived by Vals AI after performance saturated. Metric: % accuracy.

Overview

CorpFin v2

Category Metric Saturation Status

Leaderboard

Archived: Vals AI no longer runs CorpFin v2 on new model releases because performance on it has saturated. Its last leaderboard update was 2026-08-12, so newer models have no CorpFin v2 score.

Quick answer: CorpFin v2 is a Vals AI benchmark that tested how well AI models understand long credit agreements, often more than 200 pages. It has 858 private test questions from 43 documents. The final leaderboard is led by Claude Opus 5 at 73.2%, with the top models within about two points of each other.

At a Glance

What it tests: Reading and answering questions about long-context credit agreements, the dense contracts behind corporate loans.

Why it matters: Credit agreements are long, cross-referenced legal and financial documents; answering questions about them tests long-context retrieval and careful reading rather than general knowledge.

Known limitations: The benchmark is archived and saturated: the top models score within about two points of each other, so it no longer separates frontier models. The test set is private, so outside teams (Benchgen included) cannot reproduce the scores; they can only be mirrored from Vals AI.

What CorpFin v2 Measures

Each question is about a specific credit agreement and has to be answered from that document. The agreements often run past 200 pages, so models have to find the relevant clauses across a long context and reason over them accurately.

Benchmark Specifications

FieldValue
Task categoryReasoning / long-context finance documents
Questions858 test questions from 43 documents (plus 340 private validation and 20 public validation questions)
Metric% accuracy
Test setPrivate: "the privately held set for Vals AI benchmarking and is never shared"
Public set20 questions from 1 document, available from Vals AI on request
SaturationHigh
StatusArchived by Vals AI (last updated 2026-08-12)
Created byVals AI
Leaderboardvals.ai/benchmarks/corp_fin_v2

How CorpFin v2 Is Scored

Models answer questions about each credit agreement, and the score is the share of test questions answered correctly.

State-of-the-Art Results

Final Vals AI leaderboard, last updated 2026-08-12:

RankModelScoreSourceDate
1Claude Opus 573.2%Vals AI2026-08
2Claude Fable 571.8%Vals AI2026-08
3Kimi K371.6%Vals AI2026-08
4Muse Spark 1.171.3%Vals AI2026-08
5Muse Spark 1.270.9%Vals AI2026-08

The Kimi K3 score on the Benchgen leaderboard (71.6%) matches its Vals AI result.

CorpFin v2 on Benchgen

No Benchgen runs. The test set is private and the benchmark is archived, so the scores above are mirrored from Vals AI and will not be updated.

CorpFin v2 vs Other Benchmarks

BenchmarkWhat it testsSaturation
CorpFin v2Long credit agreements (archived)High
Finance Agent v2Analyst questions over public company filingsLow
Harvey Lab-AALegal knowledge-work qualityLow
SpreadsheetBench 2Spreadsheet manipulation & formula tasksLow

Run CorpFin v2 on Your Model

The official test set is private and Vals AI has stopped running the benchmark, so there is no way to get a new comparable score. For current finance results, use Finance Agent v2. On Benchgen you can build a long-document evaluation from your own contracts and track your model against it.

Frequently Asked Questions

What is CorpFin v2? CorpFin v2 is a Vals AI benchmark that tested AI models on questions about long credit agreements, often more than 200 pages, using a private set of 858 questions from 43 documents.
Is CorpFin v2 still maintained? No. Vals AI archived it because performance saturated and no longer runs it on new models. The last update was 2026-08-12.
What does a good score look like on CorpFin v2? The final top score is 73.2% (Claude Opus 5), and the top five models are within about two points of each other, which is why the benchmark no longer separates frontier models.
Who created CorpFin v2? Vals AI, an independent model-evaluation company. The test set is held privately by Vals AI and never shared; a 20-question public validation set is available on request.