69.2%
best 94.1% · Gemini 3.1 Pro Pr…
No measurement in Preference. That weight was redistributed, which is the same as assuming this model would have scored its own average there. It is an assumption, not a measurement.
Each rail is one classification. Every ranked model measured on it is a tick; this model is the orange marker. A hatched rail means this model has no measurement in that classification and its weight was redistributed.
One card per benchmark this model has been measured on. The rail shows where it sits against every other ranked model measured on the same benchmark. Where the evaluator keys on a harness, the harness is named, because the same model scores differently under a different one.
Every number on this page, with who measured it, the interval they published, the harness it was run under, and where to go and read it. Nothing here was measured by Ferrox Labs.
| Benchmark | Class | Published | Interval (normalised) | Measured by | Licence | Harness / effort | |
|---|---|---|---|---|---|---|---|
| Cybench | agents | 38.0% | not published | Cybench leaderboard | CC-BY-4.0 | source | |
| METR time horizons | agents | 1.4h | 47.3 to 61.9 | METR - Measuring AI Ability to Complete Long Tasks | CC-BY-4.0 | / 16k | source |
| Aider Polyglot | coding | 70.7% | not published | aider.chat | CC-BY-4.0 | diff | source |
| SWE-bench Verified (Epoch's own run) | coding | 70.7% | 66.6 to 74.7 | Epoch AI | CC-BY-4.0 | source | |
| LMArena Text (style-controlled) | preference | 1414 | 72.8 to 74.0 | LMArena | CC-BY-4.0 | source | |
| ARC-AGI-2 | reasoning | 1.3% | not published | ARC Prize | CC-BY-4.0 | source | |
| FrontierMath | reasoning | 4.1% | 1.8 to 6.4 | Epoch AI | CC-BY-4.0 | / 27k | source |
| GPQA Diamond (Epoch's own run) | reasoning | 69.2% | 62.7 to 75.6 | Epoch AI | CC-BY-4.0 | source | |
| Humanity's Last Exam | reasoning | 6.7% | 4.8 to 8.6 | Humanity’s Last Exam (CAIS / Scale AI) | CC-BY-4.0 | source | |
| OTIS Mock AIME 2024-2025 | reasoning | 60.0% | 45.5 to 74.5 | Epoch AI | CC-BY-4.0 | / 16k | source |
Configurations rolled up: 7. Rule: median observed configuration per benchmark (lower median, always a real measurement). Harnesses seen: diff.
Snapshot 2026-08-30-62e4e85f043b, manifest dc46131315046f1e. Grades are positional: position in the measured field, as a percentile of rank among ranked entries, n=37.