Claim · agents

Autoglm Os 9B (2025-09-25)on OSWorld

46.9 to 48.0 the range across every scoreable measurement we hold
1.1 points between the highest and the lowest
46.9 the number the board uses: the lower median, a real row with its own provenance
2 declared configurations, from 1 runner

All 2 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

Every measurement

2 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
48.0 / 100
as published: 48.0%
INDEPENDENT
counts toward the ranking
harness Specialized model
effort 50 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
46.9 / 100
as published: 46.9%
INDEPENDENT
counts toward the ranking
harness Specialized model
effort 15 steps
OSWorld (XLANG Lab)
via OSWorld leaderboard
none stated
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.