Comparing 2 models
Gemini 3.5 Flash vs Kimi K3
Benchmarks through
Verdict
Gemini 3.5 Flash and Kimi K3 are not yet ranked on the same task, so compare the specifications below. Kimi K3 costs 4.9x less per input token. Only Kimi K3 has open weights for self-hosting.
- Choose Kimi K3 for you need to self-host.
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 3.5 Flash | Kimi K3 | Source |
|---|---|---|---|
| Design Arena Coding | 1268 Elo | 1363 Elo | source · 2026-10-16 |
| Design Arena Full-stack Agent | 1197 Elo | 1315 Elo | source · 2026-10-14 |
| Design Arena UI | 1272 Elo | 1346 Elo | source · 2026-10-16 |
| Design Arena Web-app Agent | 1196 Elo | 1285 Elo | source · 2026-10-14 |
| Design Arena Website | 1269 Elo | 1337 Elo | source · 2026-10-16 |
| FrontierMath Tiers 1-3 (Epoch AI) | 62.8% ± 2.9 | 72.2% ± 2.7 | source · 2026-06-10 |
| GPQA Diamond (Epoch AI) | 88.9% ± 2.2 | 93.1% ± 1.5 | source · 2026-08-06 |
| GPQA Diamond (Epoch AI) | 86.4% ± 2.4 | 93.1% ± 1.5 | source · 2026-07-15 |
| GPQA Diamond (Epoch AI) | 92.8% ± 1.6 | 93.1% ± 1.5 | source · 2026-05-22 |
| LiveBench Agentic Coding | 49.0% | 62.2% | source · 2026-10-16 |
| LiveBench Coding | 78.2% | 81.5% | source · 2026-10-16 |
| LiveBench Data Analysis | 64.9% | 78.7% | source · 2026-10-16 |
| LiveBench Instruction Following | 75.6% | 71.4% | source · 2026-10-16 |
| LiveBench Language | 84.6% | 85.5% | source · 2026-10-16 |
| LiveBench Math | 88.2% | 84.4% | source · 2026-10-16 |
| LiveBench Reasoning | 82% | 90.7% | source · 2026-10-16 |
| LMArena Creative Writing | 1468 Elo | 1456 Elo | source · 2026-10-15 |
| LMArena Instruction Following | 1467 Elo | 1483 Elo | source · 2026-10-15 |
| LMArena Long Query | 1483 Elo | 1493 Elo | source · 2026-10-15 |
| LMArena Math | 1503 Elo | 1494 Elo | source · 2026-10-15 |
| LMArena Text | 1477 Elo | 1487 Elo | source · 2026-10-15 |
| LMArena Text Factuality | 1477 Elo | 1471 Elo | source · 2026-10-15 |
| LMArena WebDev | 1499 Elo | 1655 Elo | source · 2026-10-13 |
| LMArena WebDev Image-to-Web | 1501 Elo | 1579 Elo | source · 2026-10-09 |
| OTIS Mock AIME (Epoch AI) | 88.9% ± 4.7 | 97.2% ± 1.1 | source · 2026-08-06 |
| OTIS Mock AIME (Epoch AI) | 80% ± 6 | 97.2% ± 1.1 | source · 2026-07-15 |
| OTIS Mock AIME (Epoch AI) | 95.6% ± 2.7 | 97.2% ± 1.1 | source · 2026-05-25 |
| SimpleQA Verified (Epoch AI) | 66.2% ± 1.5 | 50.6% ± 1.6 | source · 2026-08-27 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.