All 1 scoreable measurements here come from one runner under one declared configuration, so nothing on this page explains why they differ. That is the finding.
Matched on which variant of the benchmark was sat, and on nothing else: the vendor ran it on their harness and the independent party on theirs, and that difference is the comparison rather than an obstacle to it. A vendor number with no independent run of the same variant carries no delta, because a number that cannot be compared honestly must not be compared.
| Variant | Vendor claims | Independently measured | Difference |
|---|---|---|---|
| as published, no variant stated | 72.4 | 72.4 from 1 run | 0.0 |
2 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 72.4 / 100
as published: 5.7h |
INDEPENDENT
counts toward the ranking |
gpt-5.4-2026-03-05 effort xhigh |
metr.org via Epoch AI CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 leaderboard row |
| 72.4 / 100
as published: 5.7h |
UNATTRIBUTED
shown, never scored |
gpt-5.4-2026-03-05 | METR via Epoch AI CC-BY-4.0 |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.