The Known Good Updated 25 Jul 2026
claude-3-7-sonnet-20250219 vs OpenAI: o1 ·Anthropic vs OpenAI

claude-3-7-sonnet-20250219 vs OpenAI: o1 — head-to-head comparison

claude-3-7-sonnet-20250219 profile OpenAI: o1 profile All comparisons
claude-3-7-sonnet-20250219 — Anthropic
Quality
#23 of 61
70based on 4 of 6 evaluations
Known Good Index
Speed
unranked
—
Output tokens per second
Price
unranked
—
Blended per 1M tokens
Cache hit price
unranked
—
per 1M tokens
Context
unranked
—
tokens
OpenAI: o1 — OpenAI
Quality
#30 of 61
63based on 4 of 6 evaluations
Known Good Index
Speed
#263 of 316
24.4
Output tokens per second
Price
#330 of 340
$26.25
Blended per 1M tokens
In $15.00 · Out $60.00
Cache hit price
#206 of 206
$7.50
per 1M tokens (−50%)
Context
#216 of 345
200k
tokens (~300 pages)
Summary

On the Known Good Index, claude-3-7-sonnet-20250219 scores 70 and OpenAI: o1 scores 63 — a 6-point lead for claude-3-7-sonnet-20250219. They share 10 published evaluations, with claude-3-7-sonnet-20250219 ahead on 3 and OpenAI: o1 ahead on 6.

Published pricing is tracked for OpenAI: o1 only, at $26.25 per 1M tokens blended.

claude-3-7-sonnet-20250219 is proprietary; OpenAI: o1 is proprietary. 1 tracked host serve one or both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
Metricclaude-3-7-sonnet-20250219OpenAI: o1
Known Good Index 70 based on 4 of 6 evaluations 63 based on 4 of 6 evaluations
Blended $/1M — $26.25
Output tok/s — 24
Context window — 200k
Providers 0 1
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

Metricclaude-3-7-sonnet-20250219OpenAI: o1
Known Good Index 70 63
Coding Index 71 —
Mathematics Index 72 85
Science Index 78 78
Reasoning Index 84 62
Agentic Index 57 —
Openness Index 5 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = claude-3-7-sonnet-20250219 · marker = OpenAI: o1 · scores ingested from Epoch AI (CC-BY 4.0), LiveBench (Apache-2.0)

GPQA Diamond77 / 77
MATH / AIME53 / 73
LiveBench76 / 76
LiveBench Coding75 / 70
LiveBench Data Analysis74 / 65
LiveBench Instruction Following81 / 82
LiveBench Language60 / 65
LiveBench Mathematics79 / 80
LiveBench Reasoning88 / 92
MATH Level 590 / 95

Right-hand figures read claude-3-7-sonnet-20250219 / OpenAI: o1. claude-3-7-sonnet-20250219 leads on 3 of 10, OpenAI: o1 on 6.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Metricclaude-3-7-sonnet-20250219OpenAI: o1
Text Arena 1,299 —
Text Arena (style controlled) 1,371 —
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

Metricclaude-3-7-sonnet-20250219OpenAI: o1
Input $/1M — $15.00
Output $/1M — $60.00
Blended $/1M — $26.25
Cache read $/1M — $7.500
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

Metricclaude-3-7-sonnet-20250219OpenAI: o1
Context window — 200k
Max output tokens — 100k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

Metricclaude-3-7-sonnet-20250219OpenAI: o1
Output tokens/s — 24
Time to first token — 1.4s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

1 host
Full provider benchmarks →
Provider claude-3-7-sonnet-20250219 blendedclaude-3-7-sonnet-20250219 tok/s OpenAI: o1 blendedOpenAI: o1 tok/s
OpenAI · first party — — $26.25 13

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Benchmarks — LiveBench (Apache-2.0)Elo — Arena Full attribution →