Comparing 2 models
Gemini 4 Carbon vs GPT-6.1 Sol
Benchmarks through
Verdict
Gemini 4 Carbon places higher on 18 of the 19 tasks where both are ranked. GPT-6.1 Sol accepts 1.0x more context.
- Choose Gemini 4 Carbon for Document Summarization (#1), Logic & Problem Solving (#1), a General Assistant (#1).
- Choose GPT-6.1 Sol for Tool & Function Calling (#5).
Built from the published task rankings below; ranks come from each task's own weighted benchmarks, so a win on one task says nothing about another.
Measured head to head
Benchmarks both models were run on
| Evaluation | Gemini 4 Carbon | GPT-6.1 Sol | Source |
|---|---|---|---|
| Design Arena Coding | 1348 Elo | 1362 Elo | source · 2026-11-15 |
| Design Arena UI | 1347 Elo | 1370 Elo | source · 2026-11-15 |
| Design Arena Website | 1319 Elo | 1315 Elo | source · 2026-11-15 |
| FACTS Grounding | 77.2% | 78% | source · 2026-10-29 |
| FrontierMath Tiers 1-3 (Epoch AI) | 90.5% ± 1.7 | 93.7% ± 1.4 | source · 2026-11-02 |
| GPQA Diamond (Epoch AI) | 96.5% ± 1.2 | 95.4% ± 1.4 | source · 2026-11-02 |
| LMArena Agent | 17 | 12.5 | source · 2026-11-11 |
| LMArena Agent Steerability | 19.1 | 13.4 | source · 2026-11-11 |
| LMArena Agent Task Outcome | 18.4 | 11.7 | source · 2026-11-11 |
| LMArena Agent Tool Hallucination | 0.5 | 1 | source · 2026-11-11 |
| LMArena Creative Writing | 1533 Elo | 1420 Elo | source · 2026-11-11 |
| LMArena Instruction Following | 1539 Elo | 1463 Elo | source · 2026-11-11 |
| LMArena Long Query | 1549 Elo | 1459 Elo | source · 2026-11-11 |
| LMArena Text | 1526 Elo | 1481 Elo | source · 2026-11-11 |
| LMArena Text Factuality | 1521 Elo | 1468 Elo | source · 2026-11-11 |
| LMArena WebDev | 1768 Elo | 1743 Elo | source · 2026-11-11 |
| OTIS Mock AIME (Epoch AI) | 100% ± 0 | 100% ± 0 | source · 2026-11-02 |
| SimpleQA Verified (Epoch AI) | 77.7% ± 1.3 | 73.9% ± 1.4 | source · 2026-11-02 |
| Terminal-Bench (4.1) | 64.5% | 60.9% | source · 2026-11-15 |
Values are as published by each evaluator, in its own units; rows from different evaluators are not on a common scale.
task evidence
How they place when the question changes
Lower ranks are better. “Best” marks the strongest option in this shortlist for that task.