2 independent runners have measured this, which is rare: on this snapshot only 12 of 321 claim pages can say it.
Matched on which variant of the benchmark was sat, and on nothing else: the vendor ran it on their harness and the independent party on theirs, and that difference is the comparison rather than an obstacle to it. A vendor number with no independent run of the same variant carries no delta, because a number that cannot be compared honestly must not be compared.
| Variant | Vendor claims | Independently measured | Difference |
|---|---|---|---|
| as published, no variant stated | 43.1 | 43.1 from 2 runs | 0.0 |
3 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 61.6 / 100
as published: 61.6% |
INDEPENDENT
counts toward the ranking |
gpt-5.1-codex-mini harness hookele |
tbench.ai via Epoch AI 2026-05-14 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 leaderboard row |
| 43.1 / 100
as published: 43.1% |
UNATTRIBUTED
shown, never scored |
gpt-5.1-codex-mini harness Crux |
Terminal-Bench via Epoch AI 2025-11-17 CC-BY-4.0 |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 43.1 / 100
as published: 43.1% |
INDEPENDENT
counts toward the ranking |
gpt-5.1-codex-mini harness Codex CLI |
Terminal-Bench v2 Leaderboard via Epoch AI 2025-11-17 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 Terminal-Bench v2 Leaderboard |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.