Task ranking

Best LLM for Summarization

Gemini 4 Argon ranks first for Summarization as of October 21, 2026.[1][2] It ranks #1 of 151 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts. Gemini 3.7 Flash is the next-ranked alternative. It scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.

About this recommendation

Updated
Evidence through
Sources
10
Revision
v107

Decision audit

Why this result

Inspect the inputs and the computed order behind the recommendation.

Models screened

24

live candidates

Evaluation feeds

6

task-weighted

Winner coverage

45%

intended feed weight

Largest provider share

4 of 8

Google

Established source breadth. 3 citation families and 0 practitioner families provide attributed capability reports; 0 cautionary threads retained. The largest citation family contributes 56%.

Google: Gemini 4 Argon leads the measured task comparison with 2 independent evaluation families. Community volume, release age and usage popularity add no ranking points.

Real-world track record is still developing. The recommendation can lead on independent measurements while practitioner reports accumulate.

Sources evaluated

These are the weights used in scoring. Missing measurements are omitted from each model’s average. A feed with no result for any model released in the last 60 days is stale and does not score until it catches up.

winner: Gemini 4 Argon
Evaluation feedWeightWinner resultField measured
FACTS GroundingObserved 2026-10-12 · evaluated 2026-10-12 · Gemini 4 Argon
29%
#614/24
LiveBench Instruction Followingfailing; last successful check 2026-10-18
24%
not measured20/24
LMArena Document
24%
not measured7/24
LongBench v2disabled; last successful check unknownunavailable
0%
feed unavailable0/24
LMArena Long QueryObserved 2026-10-20 · evaluation date not supplied · high effort
12%
#124/24
LMArena Text FactualityObserved 2026-10-20 · evaluation date not supplied · high effort
12%
#124/24

Provider concentration

Each exact model is scored separately; provider identity is not a ranking input.

Google50%
  • Google4 models
  • OpenAI2 models
  • Anthropic1 model
  • Qwen1 model

Decision table

Every published model is shown in computed order. Practitioner sources are distinct community threads, not the citations repeated in the prose below.

  1. Google · coverage 45%

    #1 LMArena Long Query · #1 LMArena Text Factuality

  2. Google · coverage 65%

    #2 LiveBench Instruction Following · #9 FACTS Grounding

  3. Google · coverage 65%

    #1 LiveBench Instruction Following · #7 LMArena Long Query

  4. Anthropic · coverage 60%

    #2 LMArena Document · #3 LMArena Long Query

  5. OpenAI · coverage 65%

    #2 FACTS Grounding · #11 LiveBench Instruction Following

  6. Google · coverage 45%

    #4 FACTS Grounding · #56 LMArena Text Factuality

  7. Qwen · coverage 40%

    #11 LMArena Text Factuality · #12 LiveBench Instruction Following

  8. OpenAI · coverage 85%

    #3 FACTS Grounding · #7 LiveBench Instruction Following

Task score averages the available, task-weighted measurements. Benchmark positions compare models matched to our catalog. Models measured by at least two independent evaluator families are considered first. Missing tests, practitioner report counts, popularity and release age add no points. Coverage describes evidence breadth, not a probability of correctness. Scores within two points are shown as close under this policy; this is not a statistical confidence interval. When the leading scores are that close, the model measured by more evaluator families ranks first.

  1. 01

    Gemini 4 ArgonGoogle · $2 in / $10 out per M tokens · 1.0M context

    Gemini 4 Argon ranks #1 of 151 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts.

    Best when: Its strongest result for this task is on LMArena Long Query, which measures handling long, detailed prompts.
    Source 1
    “Within the 151 catalog models matched to this evaluation: Ranks #1 of 151 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts.”
    LMArena long-query categoryOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  2. 02

    Gemini 3.7 FlashGoogle · $0.75 in / $3.75 out per M tokens · 1.0M context

    Gemini 3.7 Flash scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.

    Best when: Its strongest result for this task is on LiveBench Instruction Following, which measures following detailed instructions exactly.
    Source 2
    “Within the 59 catalog models matched to this evaluation: Scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.”
    LiveBench Instruction FollowingOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  3. 03

    Gemini 3.8 FlashGoogle · $0.83 in / $4.13 out per M tokens · 1.0M context

    Gemini 3.8 Flash scores 81.41% on LiveBench Instruction Following (#1 of 59), including paraphrasing, simplifying, story generation, and summarization.

    Best when: Its strongest result for this task is on LiveBench Instruction Following, which measures following detailed instructions exactly.
    Source 4
    “Within the 59 catalog models matched to this evaluation: Scores 81.41% on LiveBench Instruction Following (#1 of 59), including paraphrasing, simplifying, story generation, and summarization.”
    LiveBench Instruction FollowingOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  4. 04

    Claude Fable 5.1Anthropic · $10 in / $50 out per M tokens · 1M context

    Claude Fable 5.1 ranks #2 of 34 on LMArena's document arena (score 1513), based on blind preference for document tasks.

    Best when: Its strongest result for this task is on LMArena Document, which measures answering questions about uploaded documents.
    Source 5
    “Within the 34 catalog models matched to this evaluation: Ranks #2 of 34 on LMArena's document arena (score 1513), based on blind preference for document tasks.”
    LMArena document arenaOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  5. 05

    GPT-6.1 SolOpenAI · $2 in / $10 out per M tokens · 1.1M context

    GPT-6.1 Sol scores 82.4% on FACTS Grounding (#2 of 44), measuring factual support against supplied source material.

    Best when: Its strongest result for this task is on FACTS Grounding, which measures staying faithful to supplied source documents.
    Source 6
    “Within the 44 catalog models matched to this evaluation: Scores 82.4% on FACTS Grounding (#2 of 44), measuring factual support against supplied source material.”
    FACTS GroundingOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  6. 06

    Gemma 4 26B A4B Google · $0.090 in / $0.30 out per M tokens · 262K context · open-weight

    Gemma 4 26B A4B scores 80.9% on FACTS Grounding (#4 of 44), measuring factual support against supplied source material.

    Best when: Its strongest result for this task is on FACTS Grounding, which measures staying faithful to supplied source documents.
    Source 3
    “Within the 44 catalog models matched to this evaluation: Scores 80.9% on FACTS Grounding (#4 of 44), measuring factual support against supplied source material.”
    FACTS GroundingOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  7. 07

    Qwen3.7 MaxQwen · $1.48 in / $4.42 out per M tokens · 1M context

    Moderate performance across preference benchmarks with competitive factuality ranking.

    Best when: Use when factual accuracy matters: ranks #11 on LMArena factuality text view (Elo 1480).
    Source 7
    “Within the 112 catalog models matched to this evaluation: Ranks #11 of 112 on LMArena's factuality text view (Elo 1480), where answers are judged for factual accuracy in blind comparison.”
    LMArena text factualityOpen original ↗

    No practitioner reports are linked yet, so no cautions are listed. Absence of reports is not evidence of reliability.

  8. 08

    GPT-6 AstraOpenAI · $10 in / $50 out per M tokens · 1.1M context

    Strong source grounding and competitive LiveBench performance, with middling preference rankings.

    Best when: Use for source-critical summarization: scores 82% on FACTS Grounding (#3 of 44).
    Source 8
    “Within the 44 catalog models matched to this evaluation: Scores 82% on FACTS Grounding (#3 of 44), measuring factual support against supplied source material.”
    FACTS GroundingOpen original ↗

    More tips

    • Deploy for instruction-following summarization: scores 75.58% on LiveBench Instruction Following (#7 of 59).
      Source 9
      “Within the 59 catalog models matched to this evaluation: Scores 75.58% on LiveBench Instruction Following (#7 of 59), including paraphrasing, simplifying, story generation, and summarization.”
      LiveBench Instruction FollowingOpen original ↗

    Watch out for

    • Expect lower blind preference on long queries: ranks #37 on LMArena long-query category (Elo 1460).
      Source 10
      “Within the 151 catalog models matched to this evaluation: Ranks #37 of 151 on LMArena's long-query category (Elo 1460), based on blind human preference for longer prompts.”
      LMArena long-query categoryOpen original ↗

Frequently asked

What is the best model for Summarization?
Gemini 4 Argon ranks first as of October 21, 2026. Gemini 4 Argon ranks #1 of 151 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts.[1]
What is the best alternative to Gemini 4 Argon?
Gemini 3.7 Flash ranks second. Gemini 3.7 Flash scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.[2]
Which open-weight model ranks highest for Summarization?
Gemma 4 26B A4B is the highest-ranked open-weight model, at #6. Gemma 4 26B A4B scores 80.9% on FACTS Grounding (#4 of 44), measuring factual support against supplied source material.[3]

Sources

  1. 1

    “Within the 151 catalog models matched to this evaluation: Ranks #1 of 151 on LMArena's long-query category (Elo 1547), based on blind human preference for longer prompts.”

    LMArena long-query category · Benchmark · Oct 20, 2026
  2. 2

    “Within the 59 catalog models matched to this evaluation: Scores 79.93% on LiveBench Instruction Following (#2 of 59), including paraphrasing, simplifying, story generation, and summarization.”

    LiveBench Instruction Following · Benchmark · Oct 18, 2026
  3. 3

    “Within the 44 catalog models matched to this evaluation: Scores 80.9% on FACTS Grounding (#4 of 44), measuring factual support against supplied source material.”

    FACTS Grounding · Benchmark · Oct 21, 2026
  4. 4

    “Within the 59 catalog models matched to this evaluation: Scores 81.41% on LiveBench Instruction Following (#1 of 59), including paraphrasing, simplifying, story generation, and summarization.”

    LiveBench Instruction Following · Benchmark · Oct 18, 2026
  5. 5

    “Within the 34 catalog models matched to this evaluation: Ranks #2 of 34 on LMArena's document arena (score 1513), based on blind preference for document tasks.”

    LMArena document arena · Benchmark · Sep 13, 2026
  6. 6

    “Within the 44 catalog models matched to this evaluation: Scores 82.4% on FACTS Grounding (#2 of 44), measuring factual support against supplied source material.”

    FACTS Grounding · Benchmark · Oct 13, 2026
  7. 7

    “Within the 112 catalog models matched to this evaluation: Ranks #11 of 112 on LMArena's factuality text view (Elo 1480), where answers are judged for factual accuracy in blind comparison.”

    LMArena text factuality · Benchmark · Oct 20, 2026
  8. 8

    “Within the 44 catalog models matched to this evaluation: Scores 82% on FACTS Grounding (#3 of 44), measuring factual support against supplied source material.”

    FACTS Grounding · Benchmark · Sep 11, 2026
  9. 9

    “Within the 59 catalog models matched to this evaluation: Scores 75.58% on LiveBench Instruction Following (#7 of 59), including paraphrasing, simplifying, story generation, and summarization.”

    LiveBench Instruction Following · Benchmark · Oct 18, 2026
  10. 10

    “Within the 151 catalog models matched to this evaluation: Ranks #37 of 151 on LMArena's long-query category (Elo 1460), based on blind human preference for longer prompts.”

    LMArena long-query category · Benchmark · Oct 20, 2026

Rankings synthesized from community evidence and open benchmarks. See methodology. Not driven by vendor marketing.