The Known Good Updated 25 Jul 2026
gemma-3-27b-it vs Microsoft: Phi 4 ·Google vs Microsoft

gemma-3-27b-it vs Microsoft: Phi 4 — head-to-head comparison

gemma-3-27b-it profile Microsoft: Phi 4 profile All comparisons
gemma-3-27b-it — Google
Quality
#48 of 61
37based on 3 of 6 evaluations
Known Good Index
Speed
unranked
—
Output tokens per second
Price
unranked
—
Blended per 1M tokens
Cache hit price
unranked
—
per 1M tokens
Context
unranked
—
tokens
Microsoft: Phi 4 — Microsoft
Quality
#50 of 61
33based on 3 of 6 evaluations
Known Good Index
Speed
#142 of 316
56.1
Output tokens per second
Price
#40 of 340
$0.09
Blended per 1M tokens
In $0.07 · Out $0.14
Cache hit price
unranked
—
per 1M tokens
Context
#334 of 345
16k
tokens (~25 pages)
Summary

On the Known Good Index, gemma-3-27b-it scores 37 and Microsoft: Phi 4 scores 33 — a 4-point lead for gemma-3-27b-it. They share 10 published evaluations, with gemma-3-27b-it ahead on 8 and Microsoft: Phi 4 ahead on 2.

Published pricing is tracked for Microsoft: Phi 4 only, at $0.09 per 1M tokens blended.

gemma-3-27b-it is open weights under Open weights (restricted use); Microsoft: Phi 4 is open weights under Open weights (unrestricted). 1 tracked host serve one or both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
Metricgemma-3-27b-itMicrosoft: Phi 4
Known Good Index 37 based on 3 of 6 evaluations 33 based on 3 of 6 evaluations
Blended $/1M — $0.09
Output tok/s — 56
Context window — 16k
Providers 0 1
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

Metricgemma-3-27b-itMicrosoft: Phi 4
Known Good Index 37 33
Mathematics Index 47 39
Science Index 44 53
Reasoning Index 40 47
Openness Index 60 60
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = gemma-3-27b-it · marker = Microsoft: Phi 4 · scores ingested from Epoch AI (CC-BY 4.0), LiveBench (Apache-2.0)

GPQA Diamond49 / 56
MATH / AIME20 / 14
LiveBench50 / 42
LiveBench Coding40 / 31
LiveBench Data Analysis51 / 45
LiveBench Instruction Following75 / 58
LiveBench Language35 / 26
LiveBench Mathematics55 / 42
LiveBench Reasoning44 / 48
MATH Level 574 / 65

Right-hand figures read gemma-3-27b-it / Microsoft: Phi 4. gemma-3-27b-it leads on 8 of 10, Microsoft: Phi 4 on 2.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Metricgemma-3-27b-itMicrosoft: Phi 4
Text Arena 1,358 1,217
Text Arena (style controlled) 1,366 1,256
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

Metricgemma-3-27b-itMicrosoft: Phi 4
Input $/1M — $0.07
Output $/1M — $0.14
Blended $/1M — $0.09
Cache read $/1M — —
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

Metricgemma-3-27b-itMicrosoft: Phi 4
Context window — 16k
Max output tokens — 16k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

Metricgemma-3-27b-itMicrosoft: Phi 4
Output tokens/s — 56
Time to first token — 0.2s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

1 host
Full provider benchmarks →
Provider gemma-3-27b-it blendedgemma-3-27b-it tok/s Microsoft: Phi 4 blendedMicrosoft: Phi 4 tok/s
DeepInfra — — $0.09 70

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Benchmarks — LiveBench (Apache-2.0)Elo — Arena Full attribution →