The Known Good Updated 25 Jul 2026
gemma-3-27b-it vs OpenAI: GPT-5 Mini ·Google vs OpenAI

gemma-3-27b-it vs OpenAI: GPT-5 Mini — head-to-head comparison

gemma-3-27b-it profile OpenAI: GPT-5 Mini profile All comparisons
gemma-3-27b-it — Google
Quality
#48 of 61
37based on 3 of 6 evaluations
Known Good Index
Speed
unranked
—
Output tokens per second
Price
unranked
—
Blended per 1M tokens
Cache hit price
unranked
—
per 1M tokens
Context
unranked
—
tokens
OpenAI: GPT-5 Mini — OpenAI
Quality
#34 of 61
60based on 5 of 6 evaluations
Known Good Index
Speed
#47 of 316
99.9
Output tokens per second
Price
#162 of 340
$0.69
Blended per 1M tokens
In $0.25 · Out $2.00
Cache hit price
#39 of 206
$0.025
per 1M tokens (−90%)
Context
#104 of 345
400k
tokens (~600 pages)
Summary

On the Known Good Index, gemma-3-27b-it scores 37 and OpenAI: GPT-5 Mini scores 60 — a 24-point lead for OpenAI: GPT-5 Mini. They share 3 published evaluations, with gemma-3-27b-it ahead on 0 and OpenAI: GPT-5 Mini ahead on 3.

Published pricing is tracked for OpenAI: GPT-5 Mini only, at $0.69 per 1M tokens blended.

gemma-3-27b-it is open weights under Open weights (restricted use); OpenAI: GPT-5 Mini is proprietary. 2 tracked hosts serve one or both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
Metricgemma-3-27b-itOpenAI: GPT-5 Mini
Known Good Index 37 based on 3 of 6 evaluations 60 based on 5 of 6 evaluations
Blended $/1M — $0.69
Output tok/s — 100
Context window — 400k
Providers 0 2
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

Metricgemma-3-27b-itOpenAI: GPT-5 Mini
Known Good Index 37 60
Coding Index — 50
Mathematics Index 47 93
Science Index 44 76
Reasoning Index 40 57
Agentic Index — 50
Openness Index 60 5
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = gemma-3-27b-it · marker = OpenAI: GPT-5 Mini · scores ingested from Epoch AI (CC-BY 4.0)

GPQA Diamond49 / 75
MATH / AIME20 / 87
MATH Level 574 / 98

Right-hand figures read gemma-3-27b-it / OpenAI: GPT-5 Mini. gemma-3-27b-it leads on 0 of 3, OpenAI: GPT-5 Mini on 3.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Metricgemma-3-27b-itOpenAI: GPT-5 Mini
Text Arena 1,358 —
Text Arena (style controlled) 1,366 —
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

Metricgemma-3-27b-itOpenAI: GPT-5 Mini
Input $/1M — $0.25
Output $/1M — $2.00
Blended $/1M — $0.69
Cache read $/1M — $0.025
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

Metricgemma-3-27b-itOpenAI: GPT-5 Mini
Context window — 400k
Max output tokens — 128k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

Metricgemma-3-27b-itOpenAI: GPT-5 Mini
Output tokens/s — 100
Time to first token — 3.3s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

2 hosts
Full provider benchmarks →
Provider gemma-3-27b-it blendedgemma-3-27b-it tok/s OpenAI: GPT-5 Mini blendedOpenAI: GPT-5 Mini tok/s
OpenAI · first party — — $0.34 142
Azure · first party — — $0.69 78

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Elo — Arena Full attribution →