All 2 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.
2 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 64.9 / 100
as published: 64.9% |
INDEPENDENT
counts toward the ranking |
harness diff effort 32k |
aider.chat via Epoch AI 2025-02-24 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 https://aider.chat/docs/leaderboards/▶ | claude-3-7-sonnet-20250219 (no thinking) |
| 60.4 / 100
as published: 60.4% |
INDEPENDENT
counts toward the ranking |
harness diff | aider.chat via Epoch AI 2025-02-24 CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 https://aider.chat/docs/leaderboards/▶ | claude-3-7-sonnet-20250219 (no thinking) |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.