Comparing 2 models
Gemini 3.7 Flash vs GPT-6 Astra
Benchmarks through
Verdict
Gemini 3.7 Flash and GPT-6 Astra split the 10 tasks where both are ranked, 5 each. Gemini 3.7 Flash costs 13.3x less per input token. GPT-6 Astra accepts 1.0x more context.
- Choose Gemini 3.7 Flash for Writing (#2), Creative Writing (#2), RAG & Long Context (#3).
- Choose GPT-6 Astra for Grounded RAG (#2), Literary Translation (#4), Everyday Translation (#4).
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 3.7 Flash | GPT-6 Astra | Source |
|---|---|---|---|
| FACTS Grounding | 75.5% | 82% | source · 2026-08-27 |
| FrontierMath Tiers 1-3 (Epoch AI) | 71.6% ± 2.7 | 93.7% ± 1.4 | source · 2026-08-14 |
| GPQA Diamond (Epoch AI) | 94.8% ± 1.3 | 95.8% ± 1.4 | source · 2026-08-14 |
| LiveBench Agentic Coding | 58.3% | 57.3% | source · 2026-10-18 |
| LiveBench Coding | 78.9% | 80.4% | source · 2026-10-18 |
| LiveBench Data Analysis | 68.0% | 83.0% | source · 2026-10-18 |
| LiveBench Instruction Following | 79.9% | 75.6% | source · 2026-10-18 |
| LiveBench Language | 85.5% | 89.4% | source · 2026-10-18 |
| LiveBench Math | 93.5% | 96.8% | source · 2026-10-18 |
| LiveBench Reasoning | 87.8% | 92.7% | source · 2026-10-18 |
| LMArena Agent | -1.1 | 15.1 | source · 2026-10-19 |
| LMArena Agent Bash Recovery | -5.4 | 5.5 | source · 2026-10-08 |
| LMArena Agent Steerability | -4.1 | 15.5 | source · 2026-10-19 |
| LMArena Agent Task Outcome | -2 | 12.8 | source · 2026-10-19 |
| LMArena Agent Tool Hallucination | 0.5 | 0.7 | source · 2026-10-19 |
| LMArena Creative Writing | 1489 Elo | 1421 Elo | source · 2026-10-15 |
| LMArena Instruction Following | 1484 Elo | 1455 Elo | source · 2026-10-15 |
| LMArena Long Query | 1492 Elo | 1461 Elo | source · 2026-10-15 |
| LMArena Math | 1510 Elo | 1465 Elo | source · 2026-10-15 |
| LMArena Text | 1488 Elo | 1477 Elo | source · 2026-10-15 |
| LMArena Text Factuality | 1475 Elo | 1466 Elo | source · 2026-10-15 |
| LMArena Vision | 1295 Elo | 1285 Elo | source · 2026-10-19 |
| LMArena Vision Diagrams | 1320 Elo | 1310 Elo | source · 2026-10-19 |
| LMArena Vision OCR | 1308 Elo | 1299 Elo | source · 2026-10-19 |
| LMArena WebDev | 1591 Elo | 1774 Elo | source · 2026-10-19 |
| LMArena WebDev Image-to-Web | 1599 Elo | 1726 Elo | source · 2026-10-19 |
| OTIS Mock AIME (Epoch AI) | 97.2% ± 1.9 | 100% ± 0 | source · 2026-08-14 |
| SimpleQA Verified (Epoch AI) | 69.2% ± 1.5 | 75.6% ± 1.4 | source · 2026-08-27 |
| Terminal-Bench (4.0) | 11.2% | 58.2% | source · 2026-10-20 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.