Quality
How Google: Gemma 3 4B compares against every tracked model
Composite of GPQA Diamond, Mock AIME 2024–25, MATH Level 5, SWE-bench Verified, LiveBench, Humanity's Last Exam and Terminal-Bench, normalised 0–100. Scores are ingested from Epoch AI; we do not run these evaluations. This model is not in this ranking: it holds no Known Good Index score.
Quality Breakdown
Google: Gemma 3 4B on each evaluation feeding the index, against the tracked average
Bar = Google: Gemma 3 4B · grey marker = average across tracked models · scores ingested from Epoch AI
Arena Elo
Human preference rating from blind pairwise votes
Elo from blind pairwise votes, ingested from Arena
Ingested 4 Sep 2026.
Price & Cost
Published API pricing by token type
USD per 1M tokens at a 3:1 input:output blend. Live from OpenRouter, cross-checked against models.dev. Lower is better. Ranked against the 442 models priced above zero, which is the population the chart draws; excludes 29 published at no cost (free and promotional tiers).
Context Window
Maximum input tokens accepted
Maximum input context from provider metadata via models.dev and OpenRouter. Higher is better.
Speed
Mean output throughput across hosting providers, over successful measurements from the last 48 hours
Mean output tokens per second across all tracked providers, over successful measurements from the last 48 hours. Derived from OpenRouter endpoint telemetry. Higher is better.
Latency
Time to first token, mean across providers over successful measurements from the last 48 hours
Seconds to first streamed chunk, mean across tracked providers over successful measurements from the last 48 hours. Derived from OpenRouter endpoint telemetry. Lower is better.
Providers
Hosts serving Google: Gemma 3 4B, with their own price and speed
| Provider | Input $/M | Output $/M | Blended | Speed | TTFT | Context |
|---|---|---|---|---|---|---|
| DeepInfra | $0.05 | $0.10 | $0.06 | 14 | 0.8s | 131k |
Per-host pricing and telemetry from OpenRouter. Speed is output tokens per second; TTFT is time to first token.
History
How price and quality have moved since we began tracking this model
Since 25 Jul 2026
| Known Good Index | — |
| Blended price | $0.06 per 1M · observed 4 Sep 2026 |
| Output speed | 19 tok/s · observed 4 Sep 2026 |
| Time to first token | 0.7s |
No recorded changes for this model since tracking began.
Comparisons
Head-to-head pages pairing Google: Gemma 3 4B with other tracked models
Head-to-head pages are generated for the top 50 models by Known Good Index, which Google: Gemma 3 4B is not currently in. Its nearest tracked models by index are below.