Comparing 2 models
Gemini 3.5 Flash vs GPT-6 Astra
Benchmarks through
Verdict
GPT-6 Astra places higher on 5 of the 7 tasks where both are ranked. Gemini 3.5 Flash costs 6.7x less per input token. GPT-6 Astra accepts 1.0x more context.
- Choose Gemini 3.5 Flash for Creative Writing (#6), Writing (#6).
- Choose GPT-6 Astra for Grounded RAG (#2), Translation (#4), Literary Translation (#4).
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 3.5 Flash | GPT-6 Astra | Source |
|---|---|---|---|
| FACTS Grounding | 73.2% | 82% | source · 2026-10-16 |
| FrontierMath Tiers 1-3 (Epoch AI) | 62.8% ± 2.9 | 93.7% ± 1.4 | source · 2026-06-10 |
| GPQA Diamond (Epoch AI) | 88.9% ± 2.2 | 95.8% ± 1.4 | source · 2026-08-06 |
| GPQA Diamond (Epoch AI) | 86.4% ± 2.4 | 95.8% ± 1.4 | source · 2026-07-15 |
| GPQA Diamond (Epoch AI) | 92.8% ± 1.6 | 95.8% ± 1.4 | source · 2026-05-22 |
| LiveBench Agentic Coding | 49.0% | 57.3% | source · 2026-10-16 |
| LiveBench Coding | 78.2% | 80.4% | source · 2026-10-16 |
| LiveBench Data Analysis | 64.9% | 83.0% | source · 2026-10-16 |
| LiveBench Instruction Following | 75.6% | 75.6% | source · 2026-10-16 |
| LiveBench Language | 84.6% | 89.4% | source · 2026-10-16 |
| LiveBench Math | 88.2% | 96.8% | source · 2026-10-16 |
| LiveBench Reasoning | 82% | 92.7% | source · 2026-10-16 |
| LMArena Creative Writing | 1468 Elo | 1421 Elo | source · 2026-10-15 |
| LMArena Instruction Following | 1467 Elo | 1455 Elo | source · 2026-10-15 |
| LMArena Long Query | 1483 Elo | 1461 Elo | source · 2026-10-15 |
| LMArena Math | 1503 Elo | 1465 Elo | source · 2026-10-15 |
| LMArena Text | 1477 Elo | 1477 Elo | source · 2026-10-15 |
| LMArena Text Factuality | 1477 Elo | 1466 Elo | source · 2026-10-15 |
| LMArena Vision | 1284 Elo | 1286 Elo | source · 2026-10-09 |
| LMArena Vision Diagrams | 1309 Elo | 1311 Elo | source · 2026-10-09 |
| LMArena Vision OCR | 1293 Elo | 1302 Elo | source · 2026-10-09 |
| LMArena WebDev | 1499 Elo | 1780 Elo | source · 2026-10-13 |
| LMArena WebDev Image-to-Web | 1501 Elo | 1731 Elo | source · 2026-10-09 |
| OTIS Mock AIME (Epoch AI) | 88.9% ± 4.7 | 100% ± 0 | source · 2026-08-06 |
| OTIS Mock AIME (Epoch AI) | 80% ± 6 | 100% ± 0 | source · 2026-07-15 |
| OTIS Mock AIME (Epoch AI) | 95.6% ± 2.7 | 100% ± 0 | source · 2026-05-25 |
| SimpleQA Verified (Epoch AI) | 66.2% ± 1.5 | 75.6% ± 1.4 | source · 2026-08-27 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.