Claim · agents

Claude 4 Sonnet (2025-05-14)on OSWorld

31.2 to 43.9 the range across every scoreable measurement we hold
12.7 points between the highest and the lowest
41.4 the number the board uses: the lower median, a real row with its own provenance
3 declared configurations, from 1 runner

All 3 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

Every measurement

3 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
43.9 / 100
as published: 43.9%
INDEPENDENT
counts toward the ranking
harness General model
effort 50 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
41.4 / 100
as published: 41.4%
INDEPENDENT
counts toward the ranking
harness General model
effort 100 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
31.2 / 100
as published: 31.2%
INDEPENDENT
counts toward the ranking
harness General model
effort 15 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.