Comparing 2 models
Gemini 3.8 Flash vs GPT-6.1 Sol
Benchmarks through
Verdict
Gemini 3.8 Flash places higher on 11 of the 15 tasks where both are ranked. Gemini 3.8 Flash costs 2.4x less per input token. GPT-6.1 Sol accepts 1.0x more context.
- Choose Gemini 3.8 Flash for Translation (#1), Charts & Diagrams (#1), Literary Translation (#1).
- Choose GPT-6.1 Sol for Image Understanding (#1), Computer & Browser Use (#2), RAG & Long Context (#2).
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 3.8 Flash | GPT-6.1 Sol | Source |
|---|---|---|---|
| Design Arena Coding | 1306 Elo | 1346 Elo | source · 2026-10-16 |
| Design Arena UI | 1319 Elo | 1331 Elo | source · 2026-10-16 |
| Design Arena Website | 1303 Elo | 1323 Elo | source · 2026-10-16 |
| FACTS Grounding | 73.1% | 82.4% | source · 2026-09-03 |
| FrontierMath Tiers 1-3 (Epoch AI) | 68.4% ± 2.8 | 93.7% ± 1.4 | source · 2026-09-02 |
| GPQA Diamond (Epoch AI) | 95.4% ± 1.4 | 95.4% ± 1.4 | source · 2026-09-02 |
| LiveBench Agentic Coding | 54.2% | 54.5% | source · 2026-10-16 |
| LiveBench Coding | 72.5% | 80.4% | source · 2026-10-16 |
| LiveBench Data Analysis | 54.0% | 82.7% | source · 2026-10-16 |
| LiveBench Instruction Following | 81.4% | 74.2% | source · 2026-10-16 |
| LiveBench Language | 87.8% | 90.1% | source · 2026-10-16 |
| LiveBench Math | 91.6% | 96.8% | source · 2026-10-16 |
| LiveBench Reasoning | 89.3% | 92.6% | source · 2026-10-16 |
| LMArena Agent | 4 | 14.8 | source · 2026-10-14 |
| LMArena Agent Bash Recovery | -0.7 | 4.5 | source · 2026-10-08 |
| LMArena Agent Steerability | 2.1 | 14.7 | source · 2026-10-14 |
| LMArena Agent Task Outcome | 5.1 | 15.7 | source · 2026-10-14 |
| LMArena Agent Tool Hallucination | 0.5 | 0.6 | source · 2026-10-14 |
| LMArena Creative Writing | 1492 Elo | 1430 Elo | source · 2026-10-15 |
| LMArena Instruction Following | 1491 Elo | 1469 Elo | source · 2026-10-15 |
| LMArena Long Query | 1507 Elo | 1464 Elo | source · 2026-10-15 |
| LMArena Math | 1527 Elo | 1470 Elo | source · 2026-10-15 |
| LMArena Text | 1496 Elo | 1484 Elo | source · 2026-10-15 |
| LMArena Text Factuality | 1474 Elo | 1465 Elo | source · 2026-10-15 |
| LMArena Vision | 1289 Elo | 1294 Elo | source · 2026-10-09 |
| LMArena Vision Diagrams | 1333 Elo | 1311 Elo | source · 2026-10-09 |
| LMArena Vision OCR | 1317 Elo | 1295 Elo | source · 2026-10-09 |
| LMArena WebDev | 1585 Elo | 1760 Elo | source · 2026-10-13 |
| LMArena WebDev Image-to-Web | 1593 Elo | 1703 Elo | source · 2026-10-09 |
| OTIS Mock AIME (Epoch AI) | 98.9% ± 0.9 | 100% ± 0 | source · 2026-09-02 |
| SimpleQA Verified (Epoch AI) | 69.7% ± 1.5 | 73.9% ± 1.4 | source · 2026-09-02 |
| Terminal-Bench (4.0) | 19.1% | 58.2% | source · 2026-10-16 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.