The Known Good Updated 25 Jul 2026
OpenAI: GPT-5.1 vs OpenAI: o3 Mini ·OpenAI vs OpenAI

OpenAI: GPT-5.1 vs OpenAI: o3 Mini — head-to-head comparison

OpenAI: GPT-5.1 profile OpenAI: o3 Mini profile All comparisons
OpenAI: GPT-5.1 — OpenAI
Quality
#20 of 61
74based on 6 of 6 evaluations
Known Good Index
Speed
#119 of 316
61.9
Output tokens per second
Price
#261 of 340
$3.44
Blended per 1M tokens
In $1.25 · Out $10.00
Cache hit price
#105 of 206
$0.12
per 1M tokens (−90%)
Context
#101 of 345
400k
tokens (~600 pages)
OpenAI: o3 Mini — OpenAI
Quality
#15 of 61
82based on 3 of 6 evaluations
Known Good Index
Speed
#22 of 316
131.8
Output tokens per second
Price
#236 of 340
$1.93
Blended per 1M tokens
In $1.10 · Out $4.40
Cache hit price
#189 of 206
$0.55
per 1M tokens (−50%)
Context
#205 of 345
200k
tokens (~300 pages)
Summary

On the Known Good Index, OpenAI: GPT-5.1 scores 74 and OpenAI: o3 Mini scores 82 — a 8-point lead for OpenAI: o3 Mini. They share 9 published evaluations, with OpenAI: GPT-5.1 ahead on 8 and OpenAI: o3 Mini ahead on 1.

Blended pricing is $3.44 per 1M tokens for OpenAI: GPT-5.1 and $1.93 for OpenAI: o3 Mini — OpenAI: o3 Mini is about 1.8× cheaper.

Throughput is 62 tokens per second for OpenAI: GPT-5.1 and 132 for OpenAI: o3 Mini, with time to first token at 1.3s and 3.2s. OpenAI: GPT-5.1 accepts 400k tokens of context against 200k.

OpenAI: GPT-5.1 is proprietary; OpenAI: o3 Mini is proprietary. 2 tracked hosts serve one or both, and 1 serve both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
MetricOpenAI: GPT-5.1OpenAI: o3 Mini
Known Good Index 74 based on 6 of 6 evaluations 82 based on 3 of 6 evaluations
Blended $/1M $3.44 $1.93
Output tok/s 62 132
Context window 400k 200k
Providers 2 1
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

MetricOpenAI: GPT-5.1OpenAI: o3 Mini
Known Good Index 74 82
Coding Index 68 —
Mathematics Index 89 88
Science Index 91 78
Reasoning Index 80 85
Agentic Index 61 —
Openness Index 5 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = OpenAI: GPT-5.1 · marker = OpenAI: o3 Mini · scores ingested from Epoch AI (CC-BY 4.0), LiveBench (Apache-2.0)

GPQA Diamond88 / 77
MATH / AIME89 / 77
LiveBench79 / 76
LiveBench Coding72 / 83
LiveBench Data Analysis72 / 71
LiveBench Instruction Following93 / 84
LiveBench Language80 / 51
LiveBench Mathematics94 / 77
LiveBench Reasoning96 / 90

Right-hand figures read OpenAI: GPT-5.1 / OpenAI: o3 Mini. OpenAI: GPT-5.1 leads on 8 of 9, OpenAI: o3 Mini on 1.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

MetricOpenAI: GPT-5.1OpenAI: o3 Mini
Text Arena 1,422 1,319
Text Arena (style controlled) 1,439 1,348
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

MetricOpenAI: GPT-5.1OpenAI: o3 Mini
Input $/1M $1.25 $1.10
Output $/1M $10.00 $4.40
Blended $/1M $3.44 $1.93
Cache read $/1M $0.125 $0.550
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

MetricOpenAI: GPT-5.1OpenAI: o3 Mini
Context window 400k 200k
Max output tokens 128k 100k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

MetricOpenAI: GPT-5.1OpenAI: o3 Mini
Output tokens/s 62 132
Time to first token 1.3s 3.2s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

2 hosts · 1 serve both
Full provider benchmarks →
Provider OpenAI: GPT-5.1 blendedOpenAI: GPT-5.1 tok/s OpenAI: o3 Mini blendedOpenAI: o3 Mini tok/s
OpenAI · first party $1.72 82 $1.93 127
Azure · first party $3.44 58 — —

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Benchmarks — LiveBench (Apache-2.0)Elo — Arena Full attribution →