All 3 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.
3 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 56.0 / 100
as published: 56.0% |
INDEPENDENT
counts toward the ranking |
agent s2.5 w/ o3 harness Agentic framework effort 100 steps |
OSWorld (XLANG Lab) via OSWorld leaderboard none stated |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 54.2 / 100
as published: 54.2% |
INDEPENDENT
counts toward the ranking |
agent s2.5 w/ o3 harness Agentic framework effort 50 steps |
OSWorld (XLANG Lab) via OSWorld leaderboard none stated |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
| 39.0 / 100
as published: 39.0% |
INDEPENDENT
counts toward the ranking |
agent s2.5 w/ o3 harness Agentic framework effort 15 steps |
OSWorld (XLANG Lab) via OSWorld leaderboard none stated |
NO_URL2026-08-30 benchmark leaderboardthe leaderboard for this benchmark, not a link to this row |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.