Claim · agents

Gta1 W/ o3on OSWorld

48.6 to 53.1 the range across every scoreable measurement we hold
4.5 points between the highest and the lowest
48.6 the number the board uses: the lower median, a real row with its own provenance
2 declared configurations, from 1 runner

All 2 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

What the vendor said, and what someone else measured

Matched on which variant of the benchmark was sat, and on nothing else: the vendor ran it on their harness and the independent party on theirs, and that difference is the comparison rather than an obstacle to it. A vendor number with no independent run of the same variant carries no delta, because a number that cannot be compared honestly must not be compared.

VariantVendor claimsIndependently measuredDifference
as published, no variant stated 45.2 48.6 from 2 runs -3.4

Every measurement

3 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
53.1 / 100
as published: 53.1%
INDEPENDENT
counts toward the ranking
GTA1 w/ o3
harness Agentic framework
effort 100 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
48.6 / 100
as published: 48.6%
INDEPENDENT
counts toward the ranking
GTA1 w/ o3
harness Agentic framework
effort 50 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
45.2 / 100
as published: 45.2%
CLAIMED
shown, never scored
GTA1 w/ o3 (100 steps) OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.