Claim · reasoning

Claude 3.7 Sonneton OTIS Mock AIME 2024-2025

21.9 to 57.8 the range across every scoreable measurement we hold
35.8 points between the highest and the lowest
46.7 the number the board uses: the lower median, a real row with its own provenance
4 declared configurations, from 1 runner

All 4 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

Every measurement

4 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
57.8 / 100
as published: 57.8%
INDEPENDENT
counts toward the ranking
effort 64k Epoch AI
2025-03-13T21:20:00.444Z
CC-BY-4.0
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
53.3 / 100
as published: 53.3%
INDEPENDENT
counts toward the ranking
effort 32k Epoch AI
2025-03-12T19:36:44.645Z
CC-BY-4.0
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
46.7 / 100
as published: 46.7%
INDEPENDENT
counts toward the ranking
effort 16k Epoch AI
2025-02-26T16:56:46.931Z
CC-BY-4.0
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
21.9 / 100
as published: 21.9%
INDEPENDENT
counts toward the ranking
not stated by the source Epoch AI
2025-02-25T14:05:04.923Z
CC-BY-4.0
NO_URL2026-08-30
benchmark leaderboard
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.