All 4 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.
Matched on which variant of the benchmark was sat, and on nothing else: the vendor ran it on their harness and the independent party on theirs, and that difference is the comparison rather than an obstacle to it. A vendor number with no independent run of the same variant carries no delta, because a number that cannot be compared honestly must not be compared.
| Variant | Vendor claims | Independently measured | Difference |
|---|---|---|---|
| as published, no variant stated | 49.6 | 35.2 from 4 runs | +14.4 |
8 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 49.6 / 100
as published: 49.6% |
UNATTRIBUTED
shown, never scored |
harness Codex CLI | Terminal-Bench via Epoch AI 2025-11-04 CC-BY-4.0 |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 49.6 / 100
as published: 49.6% |
INDEPENDENT
counts toward the ranking |
harness Codex CLI effort medium |
Terminal-Bench v2 Leaderboard via Epoch AI 2025-11-04 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 Terminal-Bench v2 Leaderboard |
| 43.8 / 100
as published: 43.8% |
UNATTRIBUTED
shown, never scored |
harness OpenHands | Terminal-Bench via Epoch AI 2025-11-02 CC-BY-4.0 |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 43.8 / 100
as published: 43.8% |
INDEPENDENT
counts toward the ranking |
harness OpenHands effort medium |
Terminal-Bench v2 Leaderboard via Epoch AI 2025-11-02 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 Terminal-Bench v2 Leaderboard |
| 35.2 / 100
as published: 35.2% |
UNATTRIBUTED
shown, never scored |
harness Terminus 2 | Terminal-Bench via Epoch AI 2025-10-31 CC-BY-4.0 |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 35.2 / 100
as published: 35.2% |
INDEPENDENT
counts toward the ranking |
harness Terminus 2 effort medium |
Terminal-Bench v2 Leaderboard via Epoch AI 2025-10-31 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 Terminal-Bench v2 Leaderboard |
| 33.9 / 100
as published: 33.9% |
UNATTRIBUTED
shown, never scored |
harness Mini-SWE-Agent | Terminal-Bench via Epoch AI 2025-11-03 CC-BY-4.0 |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 33.9 / 100
as published: 33.9% |
INDEPENDENT
counts toward the ranking |
harness Mini-SWE-Agent effort medium |
Terminal-Bench v2 Leaderboard via Epoch AI 2025-11-03 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 Terminal-Bench v2 Leaderboard |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.