Claim · coding

Claude Opus 4.8on DeepSWE

40.8 to 59.0 the range across every scoreable measurement we hold
18.2 points between the highest and the lowest
51.8 the number the board uses: the lower median, a real row with its own provenance
5 declared configurations, from 1 runner
5 / 5 rows whose cited page still shows this figure, refetched and checked by us

All 5 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

Every measurement

5 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
59.0 / 100
as published: 59.0%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort max
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-opus-4-8",harness:"mini-swe-agent",reasoning_effort:"max",config:"mini_swe_agent_claude_opus_4_8_max",source:"deep-swe",pass_rate:0.58974358974358
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
54.4 / 100
as published: 54.4%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort xhigh
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-opus-4-8",harness:"mini-swe-agent",reasoning_effort:"xhigh",config:"mini_swe_agent_claude_opus_4_8_xhigh",source:"deep-swe",pass_rate:0.5436241610
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
51.8 / 100
as published: 51.8%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort high
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-opus-4-8",harness:"mini-swe-agent",reasoning_effort:"high",config:"mini_swe_agent_claude_opus_4_8_high",source:"deep-swe",pass_rate:0.517699115044
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
48.7 / 100
as published: 48.7%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort medium
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-opus-4-8",harness:"mini-swe-agent",reasoning_effort:"medium",config:"mini_swe_agent_claude_opus_4_8_medium",source:"deep-swe",pass_rate:0.48672566
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
40.8 / 100
as published: 40.8%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort low
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-opus-4-8",harness:"mini-swe-agent",reasoning_effort:"low",config:"mini_swe_agent_claude_opus_4_8_low",source:"deep-swe",pass_rate:0.40798226164079
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.