The Known Good Updated 25 Jul 2026
Google: Gemini 2.5 Pro vs OpenAI: GPT-4.1 ·Google vs OpenAI

Google: Gemini 2.5 Pro vs OpenAI: GPT-4.1 — head-to-head comparison

Google: Gemini 2.5 Pro profile OpenAI: GPT-4.1 profile All comparisons
Google: Gemini 2.5 Pro — Google
Quality
#29 of 61
64based on 4 of 6 evaluations
Known Good Index
Speed
#53 of 316
96.4
Output tokens per second
Price
#262 of 340
$3.44
Blended per 1M tokens
In $1.25 · Out $10.00
Cache hit price
#106 of 206
$0.12
per 1M tokens (−90%)
Context
#29 of 345
1.05M
tokens (~1,600 pages)
OpenAI: GPT-4.1 — OpenAI
Quality
#49 of 61
36based on 4 of 6 evaluations
Known Good Index
Speed
#236 of 316
33.2
Output tokens per second
Price
#268 of 340
$3.50
Blended per 1M tokens
In $2.00 · Out $8.00
Cache hit price
#174 of 206
$0.50
per 1M tokens (−75%)
Context
#49 of 345
1.05M
tokens (~1,600 pages)
Summary

On the Known Good Index, Google: Gemini 2.5 Pro scores 64 and OpenAI: GPT-4.1 scores 36 — a 28-point lead for Google: Gemini 2.5 Pro. They share 3 published evaluations, with Google: Gemini 2.5 Pro ahead on 3 and OpenAI: GPT-4.1 ahead on 0.

Blended pricing is $3.44 per 1M tokens for Google: Gemini 2.5 Pro and $3.50 for OpenAI: GPT-4.1, within 10% of each other.

Throughput is 96 tokens per second for Google: Gemini 2.5 Pro and 33 for OpenAI: GPT-4.1, with time to first token at 5.4s and 0.8s. Google: Gemini 2.5 Pro accepts 1.05M tokens of context against 1.05M.

Google: Gemini 2.5 Pro is proprietary; OpenAI: GPT-4.1 is proprietary. 4 tracked hosts serve one or both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
MetricGoogle: Gemini 2.5 ProOpenAI: GPT-4.1
Known Good Index 64 based on 4 of 6 evaluations 36 based on 4 of 6 evaluations
Blended $/1M $3.44 $3.50
Output tok/s 96 33
Context window 1.05M 1.05M
Providers 2 2
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

MetricGoogle: Gemini 2.5 ProOpenAI: GPT-4.1
Known Good Index 64 36
Coding Index 42 —
Mathematics Index 84 61
Science Index 89 66
Reasoning Index — 36
Agentic Index 42 33
Openness Index 5 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = Google: Gemini 2.5 Pro · marker = OpenAI: GPT-4.1 · scores ingested from Epoch AI (CC-BY 4.0)

GPQA Diamond85 / 67
MATH / AIME84 / 38
SWE-bench Verified58 / 49

Right-hand figures read Google: Gemini 2.5 Pro / OpenAI: GPT-4.1. Google: Gemini 2.5 Pro leads on 3 of 3, OpenAI: GPT-4.1 on 0.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

MetricGoogle: Gemini 2.5 ProOpenAI: GPT-4.1
Text Arena 1,457 —
Text Arena (style controlled) 1,446 —
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

MetricGoogle: Gemini 2.5 ProOpenAI: GPT-4.1
Input $/1M $1.25 $2.00
Output $/1M $10.00 $8.00
Blended $/1M $3.44 $3.50
Cache read $/1M $0.125 $0.500
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

MetricGoogle: Gemini 2.5 ProOpenAI: GPT-4.1
Context window 1.05M 1.05M
Max output tokens 66k 33k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

MetricGoogle: Gemini 2.5 ProOpenAI: GPT-4.1
Output tokens/s 96 33
Time to first token 5.4s 0.8s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

4 hosts
Full provider benchmarks →
Provider Google: Gemini 2.5 Pro blendedGoogle: Gemini 2.5 Pro tok/s OpenAI: GPT-4.1 blendedOpenAI: GPT-4.1 tok/s
Google AI Studio $1.72 118 — —
Google · first party $1.72 99 — —
OpenAI · first party — — $3.50 59
Azure · first party — — $3.50 42

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Elo — Arena Full attribution →