Quality
Known Good Index and the capability indices, side by side
Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.
| Metric | DeepSeek: DeepSeek V4 Pro 0423 | Google: Gemma 3 27B |
|---|---|---|
| Known Good Index | 93 | 47 |
| Mathematics Index | — | 49 |
| Reasoning Index | — | 40 |
| Openness Index | 60 | 60 |
Quality Breakdown
Every evaluation both models report a published score for
Bar = DeepSeek: DeepSeek V4 Pro 0423 · marker = Google: Gemma 3 27B · scores ingested from Epoch AI (CC-BY 4.0)
Right-hand figures read DeepSeek: DeepSeek V4 Pro 0423 / Google: Gemma 3 27B. DeepSeek: DeepSeek V4 Pro 0423 leads on 2 of 2, Google: Gemma 3 27B on 0.
Arena Elo
Human preference rating from blind pairwise votes
Elo from blind pairwise votes, ingested from Arena. Higher is better.
| Metric | DeepSeek: DeepSeek V4 Pro 0423 | Google: Gemma 3 27B |
|---|---|---|
| Text Arena | 1,451 | 1,358 |
| Text Arena (style controlled) | 1,458 | 1,365 |
Price & Cost
Published API pricing by token type
USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.
| Metric | DeepSeek: DeepSeek V4 Pro 0423 | Google: Gemma 3 27B |
|---|---|---|
| Input $/1M | $1.04 | $0.08 |
| Output $/1M | $2.08 | $0.45 |
| Blended $/1M | $1.30 | $0.17 |
| Cache read $/1M | $0.087 | $0.040 |
Context Window
Maximum input accepted and maximum output emitted
Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.
| Metric | DeepSeek: DeepSeek V4 Pro 0423 | Google: Gemma 3 27B |
|---|---|---|
| Context window | 1.05M | 131k |
| Max output tokens | 384k | 118k |
Speed & Latency
Mean throughput and time to first token across hosting providers, over successful measurements from the last 48 hours
Means across all tracked providers over successful measurements from the last 48 hours, derived from OpenRouter endpoint telemetry.
| Metric | DeepSeek: DeepSeek V4 Pro 0423 | Google: Gemma 3 27B |
|---|---|---|
| Output tokens/s | 42 | 19 |
| Time to first token | 1.5s | 1.0s |
Providers
Which hosts serve each model, and at what price and speed
| Provider | DeepSeek: DeepSeek V4 Pro 0423 blended | DeepSeek: DeepSeek V4 Pro 0423 tok/s | Google: Gemma 3 27B blended | Google: Gemma 3 27B tok/s |
|---|---|---|---|---|
| BaseTen | $2.17 | 66 | — | — |
| CoreWeave | $1.50 | 62 | — | — |
| Novita | $2.00 | 58 | $0.14 | 7 |
| Azure · first party | $2.39 | 57 | — | — |
| Alibaba · first party | $1.77 | 54 | — | — |
| Parasail | $2.17 | 52 | $0.17 | 11 |
| NextBit | $2.15 | 49 | — | — |
| Venice | $2.06 | 49 | — | — |
| Baidu · first party | $2.11 | 48 | — | — |
| AtlasCloud | $2.10 | 43 | — | — |
| DeepInfra | $1.62 | 43 | $0.10 | 16 |
| Together | $2.17 | 39 | — | — |
| SiliconFlow | $1.91 | 34 | — | — |
| DeepSeek · first party | $0.99 | 31 | — | — |
| GMICloud | $1.30 | 31 | — | — |
| StreamLake | $1.30 | 30 | — | — |
| DigitalOcean | $1.09 | 28 | — | — |
| Wafer | $1.50 | 28 | — | — |
| Ionstream | $1.41 | 26 | — | — |
| Cloudflare | $1.50 | 12 | — | — |
| Fireworks | $1.20 | — | — | — |
| Phala | — | — | $0.23 | 51 |
| Nebius | — | — | $0.15 | 7 |
Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.