The Known Good Updated 25 Jul 2026
Google: Gemma 3 27B vs OpenAI: GPT-5 Mini ·Google vs OpenAI

Google: Gemma 3 27B vs OpenAI: GPT-5 Mini — head-to-head comparison

Google: Gemma 3 27B profile OpenAI: GPT-5 Mini profile All comparisons
Google: Gemma 3 27B — Google
Quality
#47 of 61
37based on 3 of 6 evaluations
Known Good Index
Speed
#262 of 316
24.4
Output tokens per second
Price
#64 of 340
$0.17
Blended per 1M tokens
In $0.08 · Out $0.45
Cache hit price
#62 of 206
$0.040
per 1M tokens (−50%)
Context
#171 of 345
262k
tokens (~400 pages)
OpenAI: GPT-5 Mini — OpenAI
Quality
#34 of 61
60based on 5 of 6 evaluations
Known Good Index
Speed
#47 of 316
99.9
Output tokens per second
Price
#162 of 340
$0.69
Blended per 1M tokens
In $0.25 · Out $2.00
Cache hit price
#39 of 206
$0.025
per 1M tokens (−90%)
Context
#104 of 345
400k
tokens (~600 pages)
Summary

On the Known Good Index, Google: Gemma 3 27B scores 37 and OpenAI: GPT-5 Mini scores 60 — a 24-point lead for OpenAI: GPT-5 Mini. They share 3 published evaluations, with Google: Gemma 3 27B ahead on 0 and OpenAI: GPT-5 Mini ahead on 3.

Blended pricing is $0.17 per 1M tokens for Google: Gemma 3 27B and $0.69 for OpenAI: GPT-5 Mini — Google: Gemma 3 27B is about 4.0× cheaper.

Throughput is 24 tokens per second for Google: Gemma 3 27B and 100 for OpenAI: GPT-5 Mini, with time to first token at 0.9s and 3.3s. Google: Gemma 3 27B accepts 262k tokens of context against 400k.

Google: Gemma 3 27B is open weights under Open weights (restricted use); OpenAI: GPT-5 Mini is proprietary. 7 tracked hosts serve one or both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
MetricGoogle: Gemma 3 27BOpenAI: GPT-5 Mini
Known Good Index 37 based on 3 of 6 evaluations 60 based on 5 of 6 evaluations
Blended $/1M $0.17 $0.69
Output tok/s 24 100
Context window 262k 400k
Providers 5 2
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

MetricGoogle: Gemma 3 27BOpenAI: GPT-5 Mini
Known Good Index 37 60
Coding Index — 50
Mathematics Index 47 93
Science Index 44 76
Reasoning Index 40 57
Agentic Index — 50
Openness Index 60 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = Google: Gemma 3 27B · marker = OpenAI: GPT-5 Mini · scores ingested from Epoch AI (CC-BY 4.0)

GPQA Diamond49 / 75
MATH / AIME20 / 87
MATH Level 574 / 98

Right-hand figures read Google: Gemma 3 27B / OpenAI: GPT-5 Mini. Google: Gemma 3 27B leads on 0 of 3, OpenAI: GPT-5 Mini on 3.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Neither model currently appears in an arena we ingest.

The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

MetricGoogle: Gemma 3 27BOpenAI: GPT-5 Mini
Input $/1M $0.08 $0.25
Output $/1M $0.45 $2.00
Blended $/1M $0.17 $0.69
Cache read $/1M $0.040 $0.025
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

MetricGoogle: Gemma 3 27BOpenAI: GPT-5 Mini
Context window 262k 400k
Max output tokens 131k 128k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

MetricGoogle: Gemma 3 27BOpenAI: GPT-5 Mini
Output tokens/s 24 100
Time to first token 0.9s 3.3s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

7 hosts
Full provider benchmarks →
Provider Google: Gemma 3 27B blendedGoogle: Gemma 3 27B tok/s OpenAI: GPT-5 Mini blendedOpenAI: GPT-5 Mini tok/s
Parasail $0.17 54 — —
Novita $0.14 32 — —
DeepInfra $0.10 22 — —
Phala $0.23 15 — —
Nebius $0.15 12 — —
OpenAI · first party — — $0.34 142
Azure · first party — — $0.69 78

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0) Full attribution →