All 2 scoreable measurements here come from ONE runner, so this is not a reconciliation and is not presented as one. What it shows is how far a single runner's number moves when the model is run differently.
2 rows. Best first. the board takes the LOWER MEDIAN of the scoreable measurements, which is a real row with its own interval and provenance rather than an interpolated average. a vendor self-report is shown beside the independent numbers and is never one of them; it cannot move a rank.
| Score | Provenance | Configuration | Who ran it | Where to check it |
|---|---|---|---|---|
| 37.4 / 100
as published: 37.4% |
INDEPENDENT
counts toward the ranking |
gemini-3.5-flash harness mini-swe-agent effort medium |
deepswe.datacurve.ai via Epoch AI CC-BY-4.0 |
checked: this figure is not on the page today2026-08-30 the leaderboard this came fromgemini-3.5-flash [ high ] the leaderboard for this benchmark, not a link to this row |
| 36.1 / 100
as published: 36.1% |
INDEPENDENT
counts toward the ranking |
gemini-3.5-flash harness mini-swe-agent effort high |
deepswe.datacurve.ai via Epoch AI CC-BY-4.0 |
checked: this figure appears in the page’s row for this model2026-08-30 the leaderboard this came frommodel:"gemini-3-5-flash",harness:"mini-swe-agent",reasoning_effort:"high",config:"mini_swe_agent_gemini_3_5_flash_high",source:"deep-swe",pass_rate:0.3606194690 the leaderboard for this benchmark, not a link to this row |
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e, as of 2026-08-30. where only one party has measured a model on a benchmark, this page says so rather than presenting a single number as a reconciliation.