All 2 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.
Matched on which variant of the benchmark was sat, and on nothing else: the vendor ran it on their harness and the independent party on theirs, and that difference is the comparison rather than an obstacle to it. A vendor number with no independent run of the same variant carries no delta, because a number that cannot be compared honestly must not be compared.
| Variant | Vendor claims | Independently measured | Difference |
|---|---|---|---|
| as published, no variant stated | 45.2 | 48.6 from 2 runs | -3.4 |
3 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 53.1 / 100
as published: 53.1% |
INDEPENDENT
counts toward the ranking |
GTA1 w/ o3 harness Agentic framework effort 100 steps |
OSWorld (XLANG Lab) via OSWorld leaderboard none stated |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 48.6 / 100
as published: 48.6% |
INDEPENDENT
counts toward the ranking |
GTA1 w/ o3 harness Agentic framework effort 50 steps |
OSWorld (XLANG Lab) via OSWorld leaderboard none stated |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 45.2 / 100
as published: 45.2% |
CLAIMED
shown, never scored |
GTA1 w/ o3 (100 steps) | OSWorld (XLANG Lab) via OSWorld leaderboard none stated |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.