The Known Good Updated 25 Jul 2026
OpenAI: GPT-5.4 vs OpenAI: o3 ·OpenAI vs OpenAI

OpenAI: GPT-5.4 vs OpenAI: o3 — head-to-head comparison

OpenAI: GPT-5.4 profile OpenAI: o3 profile All comparisons
OpenAI: GPT-5.4 — OpenAI
Quality
#10 of 61
90based on 5 of 6 evaluations
Known Good Index
Speed
#78 of 316
82.3
Output tokens per second
Price
#299 of 340
$5.62
Blended per 1M tokens
In $2.50 · Out $15.00
Cache hit price
#160 of 206
$0.25
per 1M tokens (−90%)
Context
#15 of 345
1.05M
tokens (~1,600 pages)
OpenAI: o3 — OpenAI
Quality
#28 of 61
67based on 4 of 6 evaluations
Known Good Index
Speed
#70 of 316
88.5
Output tokens per second
Price
#269 of 340
$3.50
Blended per 1M tokens
In $2.00 · Out $8.00
Cache hit price
#175 of 206
$0.50
per 1M tokens (−75%)
Context
#203 of 345
200k
tokens (~300 pages)
Summary

On the Known Good Index, OpenAI: GPT-5.4 scores 90 and OpenAI: o3 scores 67 — a 23-point lead for OpenAI: GPT-5.4. They share 4 published evaluations, with OpenAI: GPT-5.4 ahead on 4 and OpenAI: o3 ahead on 0.

Blended pricing is $5.62 per 1M tokens for OpenAI: GPT-5.4 and $3.50 for OpenAI: o3 — OpenAI: o3 is about 1.6× cheaper.

Throughput is 82 tokens per second for OpenAI: GPT-5.4 and 88 for OpenAI: o3, with time to first token at 2.1s and 2.7s. OpenAI: GPT-5.4 accepts 1.05M tokens of context against 200k.

OpenAI: GPT-5.4 is proprietary; OpenAI: o3 is proprietary. 2 tracked hosts serve one or both, and 1 serve both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
MetricOpenAI: GPT-5.4OpenAI: o3
Known Good Index 90 based on 5 of 6 evaluations 67 based on 4 of 6 evaluations
Blended $/1M $5.62 $3.50
Output tok/s 82 88
Context window 1.05M 200k
Providers 2 1
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

MetricOpenAI: GPT-5.4OpenAI: o3
Known Good Index 90 67
Coding Index 89 —
Mathematics Index 95 92
Science Index 98 84
Reasoning Index 88 62
Agentic Index 89 60
Openness Index 5 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = OpenAI: GPT-5.4 · marker = OpenAI: o3 · scores ingested from Epoch AI (CC-BY 4.0)

GPQA Diamond93 / 82
MATH / AIME95 / 84
SWE-bench Verified77 / 62
Humanity's Last Exam36 / 20

Right-hand figures read OpenAI: GPT-5.4 / OpenAI: o3. OpenAI: GPT-5.4 leads on 4 of 4, OpenAI: o3 on 0.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

MetricOpenAI: GPT-5.4OpenAI: o3
Text Arena 1,453 —
Text Arena (style controlled) 1,466 —
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

MetricOpenAI: GPT-5.4OpenAI: o3
Input $/1M $2.50 $2.00
Output $/1M $15.00 $8.00
Blended $/1M $5.62 $3.50
Cache read $/1M $0.250 $0.500
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

MetricOpenAI: GPT-5.4OpenAI: o3
Context window 1.05M 200k
Max output tokens 128k 100k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

MetricOpenAI: GPT-5.4OpenAI: o3
Output tokens/s 82 88
Time to first token 2.1s 2.7s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

2 hosts · 1 serve both
Full provider benchmarks →
Provider OpenAI: GPT-5.4 blendedOpenAI: GPT-5.4 tok/s OpenAI: o3 blendedOpenAI: o3 tok/s
Azure · first party $5.62 79 — —
OpenAI · first party $2.81 68 $3.50 72

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Elo — Arena Full attribution →