Claim · coding

GPT-5.5on DeepSWE

27.0 to 67.0 the range across every scoreable measurement we hold
40.0 points between the highest and the lowest
54.0 the number the board uses: the lower median, a real row with its own provenance
4 declared configurations, from 1 runner
4 / 4 rows whose cited page still shows this figure, refetched and checked by us

All 4 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.

Every measurement

4 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.

ScoreProvenanceConfigurationWho ran itWhere to check it
67.0 / 100
as published: 67.0%
INDEPENDENT
counts toward the ranking
gpt-5.5
harness mini-swe-agent
effort xhigh
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"gpt-5-5",harness:"mini-swe-agent",reasoning_effort:"xhigh",config:"mini_swe_agent_gpt_5_5_xhigh",source:"deep-swe",pass_rate:0.6703539823008849,pass_at_1
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
64.4 / 100
as published: 64.4%
INDEPENDENT
counts toward the ranking
gpt-5.5
harness mini-swe-agent
effort high
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"gpt-5-5",harness:"mini-swe-agent",reasoning_effort:"high",config:"mini_swe_agent_gpt_5_5_high",source:"deep-swe",pass_rate:0.6438053097345132,pass_at_1:0
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
54.0 / 100
as published: 54.0%
INDEPENDENT
counts toward the ranking
gpt-5.5
harness mini-swe-agent
effort medium
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"gpt-5-5",harness:"mini-swe-agent",reasoning_effort:"low",config:"mini_swe_agent_gpt_5_5_low",source:"deep-swe",pass_rate:0.26991150442477874,pass_at_1:0.
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
27.0 / 100
as published: 27.0%
INDEPENDENT
counts toward the ranking
gpt-5.5
harness mini-swe-agent
effort low
deepswe.datacurve.ai
via Epoch AI
CC-BY-4.0
checked: this figure appears in the page’s row for this model2026-08-30model:"gpt-5-5",harness:"mini-swe-agent",reasoning_effort:"low",config:"mini_swe_agent_gpt_5_5_low",source:"deep-swe",pass_rate:0.26991150442477874,pass_at_1:0.
the leaderboard this came from
the leaderboard for this benchmark, not a link to this row
← The Forge Rankings

Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.