Claim · coding

Claude Sonnet 5on DeepSWE

30.5 to 53.9 the range across every scoreable measurement we hold
23.3 points between the highest and the lowest
48.2 the number the board uses: the lower median, a real row with its own provenance
5 declared configurations, from 1 runner
5 / 5 rows whose cited page still shows this figure, refetched and checked by us

All 5 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

Every measurement

5 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
53.9 / 100
as published: 53.8%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort max
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-sonnet-5",harness:"mini-swe-agent",reasoning_effort:"max",config:"mini_swe_agent_claude_sonnet_5_max",source:"deep-swe",pass_rate:0.53846153846153
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
49.7 / 100
as published: 49.7%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort xhigh
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-sonnet-5",harness:"mini-swe-agent",reasoning_effort:"xhigh",config:"mini_swe_agent_claude_sonnet_5_xhigh",source:"deep-swe",pass_rate:0.4966740576
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
48.2 / 100
as published: 48.2%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort high
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-sonnet-5",harness:"mini-swe-agent",reasoning_effort:"high",config:"mini_swe_agent_claude_sonnet_5_high",source:"deep-swe",pass_rate:0.482300884955
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
39.8 / 100
as published: 39.8%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort medium
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-sonnet-5",harness:"mini-swe-agent",reasoning_effort:"medium",config:"mini_swe_agent_claude_sonnet_5_medium",source:"deep-swe",pass_rate:0.39777777
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
30.5 / 100
as published: 30.5%
INDEPENDENT
counts toward the ranking
harness mini-swe-agent
effort low
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"claude-sonnet-5",harness:"mini-swe-agent",reasoning_effort:"low",config:"mini_swe_agent_claude_sonnet_5_low",source:"deep-swe",pass_rate:0.30512249443207
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.