Comparing 2 models
Gemini 3.7 Flash vs Kimi K3
Benchmarks through
Verdict
Kimi K3 places higher on 3 of the 5 tasks where both are ranked. Kimi K3 costs 3.1x less per input token. Only Kimi K3 has open weights for self-hosting.
- Choose Gemini 3.7 Flash for Fast Summaries (#3), Value LLM (#4).
- Choose Kimi K3 for Massive Context (#6), Cheapest Capable LLM (#6), Cheap LLM for High Volume (#6), you need to self-host.
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 3.7 Flash | Kimi K3 | Source |
|---|---|---|---|
| Design Arena Coding | 1308 Elo | 1361 Elo | source · 2026-10-21 |
| Design Arena Full-stack Agent | 1209 Elo | 1315 Elo | source · 2026-10-14 |
| Design Arena UI | 1299 Elo | 1346 Elo | source · 2026-10-21 |
| Design Arena Web-app Agent | 1222 Elo | 1296 Elo | source · 2026-10-21 |
| Design Arena Website | 1304 Elo | 1335 Elo | source · 2026-10-21 |
| FrontierMath Tiers 1-3 (Epoch AI) | 71.6% ± 2.7 | 72.2% ± 2.7 | source · 2026-08-14 |
| GPQA Diamond (Epoch AI) | 94.8% ± 1.3 | 93.1% ± 1.5 | source · 2026-08-14 |
| LiveBench Agentic Coding | 58.3% | 62.2% | source · 2026-10-18 |
| LiveBench Coding | 78.9% | 81.5% | source · 2026-10-18 |
| LiveBench Data Analysis | 68.0% | 78.7% | source · 2026-10-18 |
| LiveBench Instruction Following | 79.9% | 71.4% | source · 2026-10-18 |
| LiveBench Language | 85.5% | 85.5% | source · 2026-10-18 |
| LiveBench Math | 93.5% | 84.4% | source · 2026-10-18 |
| LiveBench Reasoning | 87.8% | 90.7% | source · 2026-10-18 |
| LMArena Agent | -1 | 1.8 | source · 2026-10-20 |
| LMArena Agent Bash Recovery | -5.4 | 4.4 | source · 2026-10-08 |
| LMArena Agent Steerability | -4.3 | 0.4 | source · 2026-10-20 |
| LMArena Agent Task Outcome | -1.7 | 6.3 | source · 2026-10-20 |
| LMArena Agent Tool Hallucination | 0.5 | 0.7 | source · 2026-10-20 |
| LMArena Creative Writing | 1488 Elo | 1457 Elo | source · 2026-10-20 |
| LMArena Instruction Following | 1484 Elo | 1485 Elo | source · 2026-10-20 |
| LMArena Long Query | 1492 Elo | 1494 Elo | source · 2026-10-20 |
| LMArena Math | 1511 Elo | 1494 Elo | source · 2026-10-20 |
| LMArena Text | 1489 Elo | 1488 Elo | source · 2026-10-20 |
| LMArena Text Factuality | 1476 Elo | 1472 Elo | source · 2026-10-20 |
| LMArena WebDev | 1591 Elo | 1655 Elo | source · 2026-10-19 |
| LMArena WebDev Image-to-Web | 1599 Elo | 1579 Elo | source · 2026-10-19 |
| OTIS Mock AIME (Epoch AI) | 97.2% ± 1.9 | 97.2% ± 1.1 | source · 2026-08-14 |
| SimpleQA Verified (Epoch AI) | 69.2% ± 1.5 | 50.6% ± 1.6 | source · 2026-08-27 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.