The Known Good Updated 25 Jul 2026
gemini-2.0-flash-001 vs Microsoft: Phi 4 ·Google DeepMind,Google vs Microsoft

gemini-2.0-flash-001 vs Microsoft: Phi 4 — head-to-head comparison

gemini-2.0-flash-001 profile Microsoft: Phi 4 profile All comparisons
gemini-2.0-flash-001 — Google DeepMind,Google
Quality
#40 of 61
53based on 3 of 6 evaluations
Known Good Index
Speed
unranked
—
Output tokens per second
Price
unranked
—
Blended per 1M tokens
Cache hit price
unranked
—
per 1M tokens
Context
unranked
—
tokens
Microsoft: Phi 4 — Microsoft
Quality
#50 of 61
33based on 3 of 6 evaluations
Known Good Index
Speed
#142 of 316
56.1
Output tokens per second
Price
#40 of 340
$0.09
Blended per 1M tokens
In $0.07 · Out $0.14
Cache hit price
unranked
—
per 1M tokens
Context
#334 of 345
16k
tokens (~25 pages)
Summary

On the Known Good Index, gemini-2.0-flash-001 scores 53 and Microsoft: Phi 4 scores 33 — a 20-point lead for gemini-2.0-flash-001. They share 10 published evaluations, with gemini-2.0-flash-001 ahead on 10 and Microsoft: Phi 4 ahead on 0.

Published pricing is tracked for Microsoft: Phi 4 only, at $0.09 per 1M tokens blended.

gemini-2.0-flash-001 is proprietary; Microsoft: Phi 4 is open weights under Open weights (unrestricted). 1 tracked host serve one or both.

Generated from tracked data on 25 Jul 2026 · how these comparisons are computed →

At a glance
Metricgemini-2.0-flash-001Microsoft: Phi 4
Known Good Index 53 based on 3 of 6 evaluations 33 based on 3 of 6 evaluations
Blended $/1M — $0.09
Output tok/s — 56
Context window — 16k
Providers 0 1
Jump to section

Quality

Known Good Index and the capability indices, side by side

IndicesComponents
Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

Metricgemini-2.0-flash-001Microsoft: Phi 4
Known Good Index 53 33
Mathematics Index 57 39
Science Index 63 53
Reasoning Index 56 47
Openness Index 5 60
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = gemini-2.0-flash-001 · marker = Microsoft: Phi 4 · scores ingested from Epoch AI (CC-BY 4.0), LiveBench (Apache-2.0)

GPQA Diamond64 / 56
MATH / AIME31 / 14
LiveBench61 / 42
LiveBench Coding54 / 31
LiveBench Data Analysis68 / 45
LiveBench Instruction Following86 / 58
LiveBench Language41 / 26
LiveBench Mathematics66 / 42
LiveBench Reasoning55 / 48
MATH Level 582 / 65

Right-hand figures read gemini-2.0-flash-001 / Microsoft: Phi 4. gemini-2.0-flash-001 leads on 10 of 10, Microsoft: Phi 4 on 0.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Metricgemini-2.0-flash-001Microsoft: Phi 4
Text Arena 1,354 1,217
Text Arena (style controlled) 1,360 1,256
The Known Good

Price & Cost

Published API pricing by token type

Per token typeCache discount
Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

Metricgemini-2.0-flash-001Microsoft: Phi 4
Input $/1M — $0.07
Output $/1M — $0.14
Blended $/1M — $0.09
Cache read $/1M — —
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

Metricgemini-2.0-flash-001Microsoft: Phi 4
Context window — 16k
Max output tokens — 16k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

Metricgemini-2.0-flash-001Microsoft: Phi 4
Output tokens/s — 56
Time to first token — 0.2s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

1 host
Full provider benchmarks →
Provider gemini-2.0-flash-001 blendedgemini-2.0-flash-001 tok/s Microsoft: Phi 4 blendedMicrosoft: Phi 4 tok/s
DeepInfra — — $0.09 70

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Benchmarks — LiveBench (Apache-2.0)Elo — Arena Full attribution →