Comparing 2 models
Gemini 3.8 Flash vs Qwen3.8 27B
Benchmarks through
Verdict
Qwen3.8 27B places higher on 3 of the 4 tasks where both are ranked. Qwen3.8 27B costs 20.6x less per input token. Gemini 3.8 Flash accepts 1.0x more context. Only Qwen3.8 27B has open weights for self-hosting.
- Choose Gemini 3.8 Flash for Fast Summaries (#1).
- Choose Qwen3.8 27B for Value LLM (#1), Cheapest Capable LLM (#1), Cheap LLM for High Volume (#1), you need to self-host.
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 3.8 Flash | Qwen3.8 27B | Source |
|---|---|---|---|
| LiveBench Agentic Coding | 54.2% | 61.4% | source · 2026-10-18 |
| LiveBench Coding | 72.5% | 75.7% | source · 2026-10-18 |
| LiveBench Data Analysis | 54.0% | 76.6% | source · 2026-10-18 |
| LiveBench Instruction Following | 81.4% | 72.7% | source · 2026-10-18 |
| LiveBench Language | 87.8% | 74.3% | source · 2026-10-18 |
| LiveBench Math | 91.6% | 86.2% | source · 2026-10-18 |
| LiveBench Reasoning | 89.3% | 80.0% | source · 2026-10-18 |
| LMArena Agent | 3.6 | -3.8 | source · 2026-10-20 |
| LMArena Agent Steerability | 1.3 | -3.9 | source · 2026-10-20 |
| LMArena Agent Task Outcome | 3.9 | -1.5 | source · 2026-10-20 |
| LMArena Agent Tool Hallucination | 0.6 | -0.1 | source · 2026-10-20 |
| LMArena Creative Writing | 1488 Elo | 1383 Elo | source · 2026-10-20 |
| LMArena Instruction Following | 1492 Elo | 1436 Elo | source · 2026-10-20 |
| LMArena Long Query | 1507 Elo | 1448 Elo | source · 2026-10-20 |
| LMArena Math | 1532 Elo | 1455 Elo | source · 2026-10-20 |
| LMArena Text | 1496 Elo | 1437 Elo | source · 2026-10-20 |
| LMArena Text Factuality | 1473 Elo | 1437 Elo | source · 2026-10-20 |
| LMArena Vision | 1291 Elo | 1242 Elo | source · 2026-10-19 |
| LMArena Vision Diagrams | 1333 Elo | 1270 Elo | source · 2026-10-19 |
| LMArena Vision OCR | 1316 Elo | 1262 Elo | source · 2026-10-19 |
| LMArena WebDev | 1585 Elo | 1593 Elo | source · 2026-10-19 |
| LMArena WebDev Image-to-Web | 1593 Elo | 1577 Elo | source · 2026-10-19 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.