Humanity's Last Exam
Expert-written questions spanning many specialist fields. Aggregated from Epoch AI's AI Benchmarking Hub (hle_external.csv, column 'Accuracy'), used under CC-BY 4.0. The Known Good aggregates published results; it runs no evaluations.
50 models scored
Higher is better
Published by Epoch AI
CC-BY 4.0
Humanity's Last Exam
Humanity's Last Exam as measured and published by Epoch AI (CC-BY 4.0). Ingested, normalised only where it feeds an index, and never re-run by us. Higher is better.
💡 A lightbulb marks a model its provider publishes as a reasoning model
The Known Good
Every model we hold a Humanity's Last Exam score for
All 50 of 50 models
| # | Model | Creator | Humanity's Last Exam | Known Good Index | Measured |
|---|---|---|---|---|---|
| 1 |
OpenAI: GPT-6 Astra
💡 |
OpenAI | 54.8 | — | 24 Oct 2026 |
| 2 |
Anthropic: Claude Fable 5.1
💡 |
Anthropic | 46.5 | — | 24 Oct 2026 |
| 3 |
Google: Gemini 3.1 Pro Preview
💡 |
46.4 | 93 | 24 Oct 2026 | |
| 4 |
Anthropic: Claude Sonnet 5.5
💡 |
Anthropic | 46.1 | — | 24 Oct 2026 |
| 5 |
Google: Gemini 3.8 Flash
💡 |
44.5 | — | 24 Oct 2026 | |
| 6 |
OpenAI: GPT-5.4 Pro
💡 |
OpenAI | 44.3 | — | 24 Oct 2026 |
| 7 |
muse-spark
|
Meta | 40.6 | — | 24 Oct 2026 |
| 8 |
gemini-3-pro-preview
|
37.5 | 81 | 24 Oct 2026 | |
| 9 |
OpenAI: GPT-5.4
💡 |
OpenAI | 36.2 | 88 | 24 Oct 2026 |
| 10 |
Anthropic: Claude Opus 4.7
💡 |
Anthropic | 36.2 | 90 | 24 Oct 2026 |
| 11 |
Anthropic: Claude Opus 4.6
💡 |
Anthropic | 34.4 | 86 | 24 Oct 2026 |
| 12 |
OpenAI: GPT-5 Pro
💡 |
OpenAI | 31.6 | — | 24 Oct 2026 |
| 13 |
Anthropic: Claude Haiku 5.5
💡 |
Anthropic | 30.1 | — | 24 Oct 2026 |
| 14 |
OpenAI: GPT-5.2
💡 |
OpenAI | 27.8 | 79 | 24 Oct 2026 |
| 15 |
OpenAI: GPT-5
💡 |
OpenAI | 25.3 | 77 | 24 Oct 2026 |
| 16 |
claude-opus-4-5-20251101-thinking
|
Anthropic | 25.2 | — | 24 Oct 2026 |
| 17 |
MoonshotAI: Kimi K2.5
💡 |
Moonshot AI | 24.4 | — | 24 Oct 2026 |
| 18 |
OpenAI: GPT-5.1
💡 |
OpenAI | 23.7 | 73 | 24 Oct 2026 |
| 19 |
Google: Gemini 2.5 Pro Preview 06-05
💡 |
21.6 | — | 24 Oct 2026 | |
| 20 |
OpenAI: o3
💡 |
OpenAI | 20.3 | 72 | 24 Oct 2026 |
| 21 |
OpenAI: GPT-5 Mini
💡 |
OpenAI | 19.4 | 66 | 24 Oct 2026 |
| 22 |
Gemini 2.5 Pro Experimental (March 2025)
|
18.2 | — | 24 Oct 2026 | |
| 23 |
OpenAI: o4 Mini
💡 |
OpenAI | 18.1 | — | 24 Oct 2026 |
| 24 |
Google: Gemini 2.5 Pro Preview 05-06
💡 |
17.8 | — | 24 Oct 2026 | |
| 25 |
Anthropic: Claude Opus 4.5
💡 |
Anthropic | 14.2 | 71 | 24 Oct 2026 |
| 26 |
claude-sonnet-4-5-20250929-thinking
|
Anthropic | 13.7 | — | 24 Oct 2026 |
| 27 |
Google: Gemini 2.5 Flash
💡 |
12.1 | — | 24 Oct 2026 | |
| 28 |
claude-opus-4-1-20250805-thinking
|
Anthropic | 11.5 | — | 24 Oct 2026 |
| 29 |
Gemini 2.5 Flash Preview (May 2025)
|
11.0 | — | 24 Oct 2026 | |
| 30 |
Anthropic: Claude Opus 4
💡 |
Anthropic | 10.7 | — | 24 Oct 2026 |
| 31 |
Google: Gemini 3.1 Flash Lite Preview
💡 |
8.6 | — | 24 Oct 2026 | |
| 32 |
Z.ai: GLM 4.5
💡 |
Z.ai | 8.3 | — | 24 Oct 2026 |
| 33 |
Z.ai: GLM 4.5 Air
💡 |
Z.ai | 8.1 | — | 24 Oct 2026 |
| 34 |
OpenAI: o1-pro
💡 |
OpenAI | 8.1 | — | 24 Oct 2026 |
| 35 |
Claude 3.7 Sonnet (Thinking)
|
Anthropic | 8.0 | — | 24 Oct 2026 |
| 36 |
OpenAI: o1
💡 |
OpenAI | 8.0 | 69 | 24 Oct 2026 |
| 37 |
Anthropic: Claude Opus 4.1
💡 |
Anthropic | 7.9 | 49 | 24 Oct 2026 |
| 38 |
Anthropic: Claude Sonnet 4
💡 |
Anthropic | 7.8 | — | 24 Oct 2026 |
| 39 |
claude-sonnet-4-5-20250929
|
Anthropic | 7.5 | 66 | 24 Oct 2026 |
| 40 |
gpt-5.1-instant
|
OpenAI | 6.8 | — | 24 Oct 2026 |
| 41 | GD Gemini 2.0 Flash Thinking (January 2025) | Google DeepMind,Google | 6.6 | — | 24 Oct 2026 |
| 42 |
Meta: Llama 4 Maverick
|
Meta | 5.7 | — | 24 Oct 2026 |
| 43 |
gpt-4.5-preview
|
OpenAI | 5.4 | 54 | 24 Oct 2026 |
| 44 |
OpenAI: GPT-4.1
|
OpenAI | 5.4 | 45 | 24 Oct 2026 |
| 45 |
gemini-1.5-pro-002
|
4.6 | — | 24 Oct 2026 | |
| 46 |
Mistral: Mistral Medium 3
|
Mistral | 4.5 | — | 24 Oct 2026 |
| 47 | Az Nova Pro | Amazon | 4.4 | — | 24 Oct 2026 |
| 48 |
Claude 3.5 Sonnet (October 2024)
|
Anthropic | 4.1 | — | 24 Oct 2026 |
| 49 | Az Nova Lite | Amazon | 3.6 | — | 24 Oct 2026 |
| 50 |
OpenAI: GPT-4o
|
OpenAI | 2.7 | 27 | 24 Oct 2026 |
The Known Good
Provenance. These figures are published by Epoch AI and redistributed here under CC-BY 4.0.
The publisher's own page is here. We did not run this evaluation and we do not adjust the published numbers — where a score feeds an index it is
min-max normalised against every other model holding the same evaluation, and nothing else is done to it.
This evaluation is one of the seven components of the
Known Good Index. Full licence detail is on attribution, and every score here is
in the CSV download.