The Known Good Updated 25 Jul 2026
claude-3-7-sonnet-20250219 vs claude-haiku-4-5-20251001 ·Anthropic vs Anthropic

claude-3-7-sonnet-20250219 vs claude-haiku-4-5-20251001 — head-to-head comparison

claude-3-7-sonnet-20250219 profile claude-haiku-4-5-20251001 profile All comparisons
claude-3-7-sonnet-20250219 — Anthropic
Quality
#23 of 61
70based on 4 of 6 evaluations
Known Good Index
Speed
unranked
Output tokens per second
Price
unranked
Blended per 1M tokens
Cache hit price
unranked
per 1M tokens
Context
unranked
tokens
claude-haiku-4-5-20251001 — Anthropic
Quality
#38 of 61
56based on 3 of 6 evaluations
Known Good Index
Speed
unranked
Output tokens per second
Price
unranked
Blended per 1M tokens
Cache hit price
unranked
per 1M tokens
Context
unranked
tokens
Summary

On the Known Good Index, claude-3-7-sonnet-20250219 scores 70 and claude-haiku-4-5-20251001 scores 56 — a 13-point lead for claude-3-7-sonnet-20250219. They share 3 published evaluations, with claude-3-7-sonnet-20250219 ahead on 1 and claude-haiku-4-5-20251001 ahead on 2.

claude-3-7-sonnet-20250219 is proprietary; claude-haiku-4-5-20251001 is proprietary.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
Metricclaude-3-7-sonnet-20250219claude-haiku-4-5-20251001
Known Good Index 70 based on 4 of 6 evaluations 56 based on 3 of 6 evaluations
Blended $/1M
Output tok/s
Context window
Providers 0 0
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

Metricclaude-3-7-sonnet-20250219claude-haiku-4-5-20251001
Known Good Index 70 56
Coding Index 71
Mathematics Index 72 82
Science Index 78 71
Reasoning Index 84
Agentic Index 57 30
Openness Index 5 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = claude-3-7-sonnet-20250219 · marker = claude-haiku-4-5-20251001 · scores ingested from Epoch AI (CC-BY 4.0)

GPQA Diamond77 / 71
MATH / AIME53 / 67
MATH Level 590 / 96

Right-hand figures read claude-3-7-sonnet-20250219 / claude-haiku-4-5-20251001. claude-3-7-sonnet-20250219 leads on 1 of 3, claude-haiku-4-5-20251001 on 2.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Metricclaude-3-7-sonnet-20250219claude-haiku-4-5-20251001
Text Arena 1,299 1,393
Text Arena (style controlled) 1,371 1,412
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

Metricclaude-3-7-sonnet-20250219claude-haiku-4-5-20251001
Input $/1M
Output $/1M
Blended $/1M
Cache read $/1M
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

Metricclaude-3-7-sonnet-20250219claude-haiku-4-5-20251001
Context window
Max output tokens
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

Metricclaude-3-7-sonnet-20250219claude-haiku-4-5-20251001
Output tokens/s
Time to first token
The Known Good

Providers

Which hosts serve each model, and at what price and speed

0 hosts
Full provider benchmarks →

No hosting providers are currently tracked for either model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Elo — Arena Full attribution →