LiveBench Language
LiveBench language subset. Published by LiveBench (Apache-2.0) and redistributed by Epoch AI under CC-BY 4.0 in live_bench_external.csv (column 'Language average'). The Known Good aggregates published results; it runs no evaluations.
52 models scored
Higher is better
Published by LiveBench
Apache-2.0
LiveBench Language
LiveBench Language as measured and published by LiveBench (Apache-2.0). Ingested, normalised only where it feeds an index, and never re-run by us. Higher is better.
16 of 52 models ▾
☰⚙⇩
+Add model from specific provider
💡 Reasoning models are indicated by a lightbulb
The Known Good
Every model we hold a LiveBench Language score for
52 of 52 models
| # | Model | Creator | LiveBench Language | Known Good Index | Measured |
|---|---|---|---|---|---|
| 1 |
OpenAI: GPT-5.1
💡 |
OpenAI | 80.2 | 74 | 25 Jul 2026 |
| 2 |
gemini-2.5-pro-exp-03-25
|
67.8 | — | 25 Jul 2026 | |
| 3 |
OpenAI: o1
💡 |
OpenAI | 65.4 | 63 | 25 Jul 2026 |
| 4 |
gpt-4.5-preview
|
OpenAI | 61.5 | 47 | 25 Jul 2026 |
| 5 |
claude-3-7-sonnet-20250219
|
Anthropic | 59.9 | 70 | 25 Jul 2026 |
| 6 |
qwen2.5-max
|
Alibaba | 56.3 | — | 25 Jul 2026 |
| 7 |
claude-3-5-sonnet-20241022
|
Anthropic | 53.8 | 40 | 25 Jul 2026 |
| 8 |
QwQ-32B
|
Alibaba | 51.4 | — | 25 Jul 2026 |
| 9 | GD gemini-exp-1206 | Google DeepMind,Google | 51.3 | — | 25 Jul 2026 |
| 10 |
OpenAI: o3 Mini
💡 |
OpenAI | 50.7 | 82 | 25 Jul 2026 |
| 11 |
claude-3-opus-20240229
|
Anthropic | 50.4 | 30 | 25 Jul 2026 |
| 12 |
DeepSeek: DeepSeek V3 0324
|
DeepSeek | 49.1 | 60 | 25 Jul 2026 |
| 13 |
DeepSeek: R1
💡 |
DeepSeek | 48.5 | 68 | 25 Jul 2026 |
| 14 |
deepseek-r1
|
DeepSeek | 48.5 | 68 | 25 Jul 2026 |
| 15 |
OpenAI: GPT-4o
|
OpenAI | 47.6 | 21 | 25 Jul 2026 |
| 16 |
DeepSeek: DeepSeek V3
|
DeepSeek | 47.5 | 44 | 25 Jul 2026 |
| 17 |
grok-2-1212
|
xAI | 45.6 | 38 | 25 Jul 2026 |
| 18 |
gemini-2.0-pro-exp-02-05
|
44.9 | — | 25 Jul 2026 | |
| 19 |
Perplexity: Sonar
|
Perplexity | 44.1 | — | 25 Jul 2026 |
| 20 | GD gemini-2.0-flash-thinking-exp-01-21 | Google DeepMind,Google | 42.2 | 62 | 25 Jul 2026 |
| 21 | L1 learnlm-1.5-pro-experimental | Unknown | 42.0 | — | 25 Jul 2026 |
| 22 |
o1-mini
|
OpenAI | 40.9 | 56 | 25 Jul 2026 |
| 23 | GD gemini-2.0-flash-001 | Google DeepMind,Google | 40.7 | 53 | 25 Jul 2026 |
| 24 |
mistral-large-2411
|
Mistral | 39.4 | 33 | 25 Jul 2026 |
| 25 |
Meta: Llama 3.3 70B Instruct
|
Meta | 39.2 | 31 | 25 Jul 2026 |
| 26 | DL Dracarys2-Llama-3.1-70B-Instruct | Unknown | 38.8 | — | 25 Jul 2026 |
| 27 | GD gemini-2.0-flash-exp | Google DeepMind,Google | 38.2 | — | 25 Jul 2026 |
| 28 | Az amazon.nova-pro-v1:0 | Amazon | 37.0 | — | 25 Jul 2026 |
| 29 |
claude-3-5-haiku-20241022
|
Anthropic | 35.4 | 23 | 25 Jul 2026 |
| 30 |
Google: Gemma 3 27B
|
34.6 | 37 | 25 Jul 2026 | |
| 31 |
gemma-3-27b-it
|
34.6 | 37 | 25 Jul 2026 | |
| 32 |
gemini-2.0-flash-lite-preview-02-05
|
34.3 | — | 25 Jul 2026 | |
| 33 | D7 Dracarys2-72B-Instruct | Unknown | 34.1 | — | 25 Jul 2026 |
| 34 |
gemini-2.0-flash-lite
|
33.6 | — | 25 Jul 2026 | |
| 35 |
Google: Gemma 2 27B
|
32.6 | 19 | 25 Jul 2026 | |
| 36 |
gemma-2-27b-it
|
32.6 | 19 | 25 Jul 2026 | |
| 37 |
mistral-small-2501
|
Mistral | 30.5 | 26 | 25 Jul 2026 |
| 38 | CC c4ai-command-r-plus-08-2024 | Cohere,Cohere for AI | 29.7 | — | 25 Jul 2026 |
| 39 |
mistral-small-2503
|
Mistral | 29.1 | 28 | 25 Jul 2026 |
| 40 |
OpenAI: GPT-4o-mini
|
OpenAI | 28.6 | 23 | 25 Jul 2026 |
| 41 |
DeepSeek-R1-Distill-Qwen-32B
|
DeepSeek | 26.8 | — | 25 Jul 2026 |
| 42 | Az amazon.nova-lite-v1:0 | Amazon | 25.9 | — | 25 Jul 2026 |
| 43 |
Microsoft: Phi 4
|
Microsoft | 25.6 | 33 | 25 Jul 2026 |
| 44 |
gemma-2-9b-it
|
25.5 | 10 | 25 Jul 2026 | |
| 45 |
DeepSeek: R1 Distill Llama 70B
💡 |
DeepSeek | 23.8 | 52 | 25 Jul 2026 |
| 46 |
Qwen2.5 Coder 32B Instruct
|
Alibaba | 23.2 | — | 25 Jul 2026 |
| 47 |
QwQ-32B-Preview
|
Alibaba | 21.1 | — | 25 Jul 2026 |
| 48 |
c4ai-command-r-08-2024
|
Cohere | 16.7 | — | 25 Jul 2026 |
| 49 | Az amazon.nova-micro-v1:0 | Amazon | 15.8 | — | 25 Jul 2026 |
| 50 |
Phi-3-small-8k-instruct
|
Microsoft | 12.9 | — | 25 Jul 2026 |
| 51 | AI OLMo-2-1124-13B-Instruct | Allen Institute for AI,University of Washington,New York University (NYU) | 11.2 | — | 25 Jul 2026 |
| 52 |
Phi-3-mini-4k-instruct
|
Microsoft | 9.2 | — | 25 Jul 2026 |
The Known Good
Provenance. These figures are published by LiveBench and redistributed here under Apache-2.0.
The publisher's own page is here. We did not run this evaluation and we do not adjust the published numbers — where a score feeds an index it is
min-max normalised against every other model holding the same evaluation, and nothing else is done to it.
Full licence detail is on attribution, and every score here is
in the CSV download.