The Known Good Updated 4 Sep 2026 Subscribe
Evaluations· LiveBench· Apache-2.0· Tracked, not in the index

LiveBench Instruction Following

LiveBench instruction-following subset. Published by LiveBench (Apache-2.0) and redistributed by Epoch AI under CC-BY 4.0 in live_bench_external.csv (column 'IF Average'). The Known Good aggregates published results; it runs no evaluations.

Publisher's page Licence & attribution How we use this score
49 models scored Higher is better Published by LiveBench Apache-2.0
Every model we hold a LiveBench Instruction Following score for
All 49 of 49 models
# Model Creator LiveBench Instruction Following Known Good Index Measured
1 OpenAI: GPT-5.1 💡 OpenAI 93.3 74 4 Sep 2026
2 gemini-2.0-flash-001 Google DeepMind,Google 85.8 61 4 Sep 2026
3 OpenAI: o3 Mini 💡 OpenAI 84.4 86 4 Sep 2026
4 gemini-2.0-pro-exp-02-05 Google 83.4 74 4 Sep 2026
5 Meta: Llama 3.3 70B Instruct Meta 82.7 34 4 Sep 2026
6 gemini-2.0-flash-thinking-exp-01-21 Google DeepMind,Google 82.5 62 4 Sep 2026
7 gemini-2.0-flash-exp Google DeepMind,Google 81.9 4 Sep 2026
8 QwQ-32B Alibaba 81.8 69 4 Sep 2026
9 OpenAI: o1 💡 OpenAI 81.5 70 4 Sep 2026
10 DeepSeek: DeepSeek V3 0324 DeepSeek 81.5 64 4 Sep 2026
11 claude-3-7-sonnet-20250219 Anthropic 81.2 74 4 Sep 2026
12 gemini-2.5-pro-exp-03-25 Google 80.6 4 Sep 2026
13 DeepSeek: R1 💡 DeepSeek 80.5 75 4 Sep 2026
14 gemini-2.0-flash-lite-preview-02-05 Google 78.3 4 Sep 2026
15 gemini-exp-1206 Google DeepMind,Google 77.3 4 Sep 2026
16 gemini-2.0-flash-lite Google 76.6 4 Sep 2026
17 Perplexity: Sonar Perplexity 76.2 4 Sep 2026
18 qwen2.5-max Alibaba 75.3 4 Sep 2026
19 DeepSeek: DeepSeek V3 DeepSeek 75.2 62 4 Sep 2026
20 Google: Gemma 3 27B 💡 Google 74.9 47 4 Sep 2026
21 gpt-4.5-preview OpenAI 72.3 54 4 Sep 2026
22 DeepSeek: R1 Distill Llama 70B 💡 DeepSeek 69.9 63 4 Sep 2026
23 grok-2-1212 xAI 69.6 45 4 Sep 2026
24 claude-3-5-sonnet-20241022 Anthropic 69.3 45 4 Sep 2026
25 OpenAI: GPT-4o OpenAI 68.6 27 4 Sep 2026
26 learnlm-1.5-pro-experimental Unknown 68.2 4 Sep 2026
27 mistral-large-2411 Mistral 67.9 37 4 Sep 2026
28 amazon.nova-pro-v1:0 Amazon 67.1 4 Sep 2026
29 o1-mini OpenAI 65.4 65 4 Sep 2026
30 Dracarys2-72B-Instruct Unknown 65.2 4 Sep 2026
31 claude-3-opus-20240229 Anthropic 63.9 32 4 Sep 2026
32 mistral-small-2503 Mistral 63.7 33 4 Sep 2026
33 Dracarys2-Llama-3.1-70B-Instruct Unknown 63.2 4 Sep 2026
34 claude-3-5-haiku-20241022 Anthropic 61.9 30 4 Sep 2026
35 OLMo-2-1124-13B-Instruct Allen Institute for AI,University of Washington,New York University (NYU) 60.6 4 Sep 2026
36 mistral-small-2501 Mistral 59.5 31 4 Sep 2026
37 Qwen2.5 Coder 32B Instruct Alibaba 58.7 4 Sep 2026
38 Microsoft: Phi 4 Microsoft 58.4 41 4 Sep 2026
39 Google: Gemma 2 27B Google 58.1 21 4 Sep 2026
40 c4ai-command-r-plus-08-2024 Cohere,Cohere for AI 57.6 4 Sep 2026
41 OpenAI: GPT-4o-mini OpenAI 56.8 31 4 Sep 2026
42 DeepSeek-R1-Distill-Qwen-32B DeepSeek 55.7 53 4 Sep 2026
43 c4ai-command-r-08-2024 Cohere 55.6 4 Sep 2026
44 amazon.nova-lite-v1:0 Amazon 54.1 4 Sep 2026
45 gemma-2-9b-it Google 52.6 13 4 Sep 2026
46 amazon.nova-micro-v1:0 Amazon 48.0 4 Sep 2026
47 Phi-3-small-8k-instruct Microsoft 47.2 4 Sep 2026
48 Phi-3-mini-4k-instruct Microsoft 39.1 4 Sep 2026
49 QwQ-32B-Preview Alibaba 35.6 4 Sep 2026
The Known Good
Provenance. These figures are published by LiveBench and redistributed here under Apache-2.0. The publisher's own page is here. We did not run this evaluation and we do not adjust the published numbers — where a score feeds an index it is min-max normalised against every other model holding the same evaluation, and nothing else is done to it. Full licence detail is on attribution, and every score here is in the CSV download.