GLM 5.1

z-ai/glm-5.1-20260406

Z.ai: GLM 5.1 is a text‑only model from the provider z‑ai that supports reasoning and tool integration, with open weights available. It provides a context length of 202 752 tokens and is priced at $0.966 per million input tokens and $3.036 per million output tokens. The model was released on 2025‑01‑20.

tool use
structured outputs
reasoning

At a glance

providerz-ai

releasedMar 27, 2026

context205K

input / M$0.97

Specifications

What the API gives you

Context window: 205K tokens
Max output: 128K tokens
Input price: $0.97 / 1M tokens
Output price: $3.04 / 1M tokens
Cache read: $0.18 / 1M tokens
Modalities: text → text
Knowledge cutoff: —
Released: Mar 27, 2026

Measured evidence

Public benchmark record

Design Arena Coding: 1308 Elo2026-07-28
Design Arena Coding: 1308 Elo2026-07-27
Design Arena Coding: 1308 Elo2026-07-30
Design Arena Coding: 1308 Elo2026-07-29
Design Arena Coding: 1307 Elo2026-07-31
Design Arena Coding: 1306 Elo2026-08-02
Design Arena Coding: 1303 Elo2026-08-05
Design Arena Coding: 1306 Elo2026-08-01
Design Arena Coding: 1301 Elo2026-08-09
Design Arena Coding: 1305 Elo2026-08-03
Design Arena Coding: 1303 Elo2026-08-04
Design Arena Coding: 1298 Elo2026-08-14
Design Arena Coding: 1303 Elo2026-08-06
Design Arena Coding: 1302 Elo2026-08-10
Design Arena Coding: 1303 Elo2026-08-07
Design Arena Coding: 1288 Elo2026-08-18
Design Arena Coding: 1302 Elo2026-08-08
Design Arena Coding: 1291 Elo2026-08-15
Design Arena Coding: 1302 Elo2026-08-11
Design Arena Coding: 1300 Elo2026-08-12
Design Arena Coding: 1294 Elo2026-08-21
Design Arena Coding: 1298 Elo2026-08-13
Design Arena Coding: 1287 Elo2026-08-19
Design Arena Coding: 1293 Elo2026-08-27
Design Arena Coding: 1287 Elo2026-08-20
Design Arena Coding: 1291 Elo2026-08-16
Design Arena Coding: 1290 Elo2026-08-17
Design Arena Coding: 1294 Elo2026-08-22
Design Arena Coding: 1294 Elo2026-08-23
Design Arena Coding: 1293 Elo2026-08-28
Design Arena Coding: 1294 Elo2026-08-24
Design Arena Coding: 1294 Elo2026-08-25
Design Arena Coding: 1294 Elo2026-08-26
Design Arena Coding: 1292 Elo2026-08-29
Design Arena Coding: 1292 Elo2026-08-30
Design Arena Coding: 1292 Elo2026-08-31
Design Arena Coding: 1292 Elo2026-09-01
Design Arena Coding: 1291 Elo2026-09-02
Design Arena Coding: 1288 Elo2026-09-03
Design Arena Coding: 1287 Elo2026-09-04
Design Arena Full-stack Agent: 1212 Elo2026-07-28
Design Arena Full-stack Agent: 1214 Elo2026-07-27
Design Arena Full-stack Agent: 1205 Elo2026-07-30
Design Arena Full-stack Agent: 1206 Elo2026-07-29
Design Arena Full-stack Agent: 1206 Elo2026-07-31
Design Arena Full-stack Agent: 1208 Elo2026-08-02
Design Arena Full-stack Agent: 1209 Elo2026-08-05
Design Arena Full-stack Agent: 1207 Elo2026-08-01
Design Arena Full-stack Agent: 1199 Elo2026-08-09
Design Arena Full-stack Agent: 1208 Elo2026-08-03
Design Arena Full-stack Agent: 1209 Elo2026-08-04
Design Arena Full-stack Agent: 1199 Elo2026-08-14
Design Arena Full-stack Agent: 1209 Elo2026-08-06
Design Arena Full-stack Agent: 1197 Elo2026-08-10
Design Arena Full-stack Agent: 1209 Elo2026-08-07
Design Arena Full-stack Agent: 1197 Elo2026-08-18
Design Arena Full-stack Agent: 1208 Elo2026-08-08
Design Arena Full-stack Agent: 1203 Elo2026-08-15
Design Arena Full-stack Agent: 1200 Elo2026-08-11
Design Arena Full-stack Agent: 1201 Elo2026-08-12
Design Arena Full-stack Agent: 1199 Elo2026-08-13
Design Arena Full-stack Agent: 1197 Elo2026-08-19
Design Arena Full-stack Agent: 1190 Elo2026-08-27
Design Arena Full-stack Agent: 1197 Elo2026-08-20
Design Arena Full-stack Agent: 1203 Elo2026-08-16
Design Arena Full-stack Agent: 1202 Elo2026-08-17
Design Arena Full-stack Agent: 1200 Elo2026-08-21
Design Arena Full-stack Agent: 1200 Elo2026-08-22
Design Arena Full-stack Agent: 1200 Elo2026-08-23
Design Arena Full-stack Agent: 1189 Elo2026-08-28
Design Arena Full-stack Agent: 1187 Elo2026-08-24
Design Arena Full-stack Agent: 1190 Elo2026-08-25
Design Arena Full-stack Agent: 1190 Elo2026-08-26
Design Arena Full-stack Agent: 1190 Elo2026-08-29
Design Arena Full-stack Agent: 1191 Elo2026-08-30
Design Arena Full-stack Agent: 1189 Elo2026-08-31
Design Arena Full-stack Agent: 1190 Elo2026-09-01
Design Arena Full-stack Agent: 1190 Elo2026-09-02
Design Arena Full-stack Agent: 1190 Elo2026-09-03
Design Arena Full-stack Agent: 1190 Elo2026-09-04
Design Arena UI: 1292 Elo2026-07-28
Design Arena UI: 1292 Elo2026-07-27
Design Arena UI: 1292 Elo2026-07-30
Design Arena UI: 1292 Elo2026-07-29
Design Arena UI: 1292 Elo2026-07-31
Design Arena UI: 1292 Elo2026-08-02
Design Arena UI: 1292 Elo2026-08-01
Design Arena UI: 1292 Elo2026-08-05
Design Arena UI: 1292 Elo2026-08-09
Design Arena UI: 1292 Elo2026-08-03
Design Arena UI: 1292 Elo2026-08-04
Design Arena UI: 1292 Elo2026-08-14
Design Arena UI: 1292 Elo2026-08-06
Design Arena UI: 1292 Elo2026-08-07
Design Arena UI: 1292 Elo2026-08-10
Design Arena UI: 1292 Elo2026-08-08
Design Arena UI: 1292 Elo2026-08-18
Design Arena UI: 1292 Elo2026-08-11
Design Arena UI: 1292 Elo2026-08-15
Design Arena UI: 1292 Elo2026-08-12
Design Arena UI: 1292 Elo2026-08-13
Design Arena UI: 1292 Elo2026-08-19
Design Arena UI: 1292 Elo2026-08-27
Design Arena UI: 1292 Elo2026-08-16
Design Arena UI: 1292 Elo2026-08-20
Design Arena UI: 1292 Elo2026-08-17
Design Arena UI: 1292 Elo2026-08-21
Design Arena UI: 1292 Elo2026-08-22
Design Arena UI: 1292 Elo2026-08-23
Design Arena UI: 1292 Elo2026-08-28
Design Arena UI: 1292 Elo2026-08-24
Design Arena UI: 1292 Elo2026-08-25
Design Arena UI: 1292 Elo2026-08-26
Design Arena UI: 1292 Elo2026-08-29
Design Arena UI: 1292 Elo2026-08-30
Design Arena UI: 1292 Elo2026-08-31
Design Arena UI: 1292 Elo2026-09-01
Design Arena UI: 1292 Elo2026-09-02
Design Arena UI: 1292 Elo2026-09-03
Design Arena UI: 1290 Elo2026-09-04
Design Arena Web-app Agent: 1225 Elo2026-07-28
Design Arena Web-app Agent: 1225 Elo2026-07-27
Design Arena Web-app Agent: 1224 Elo2026-07-30
Design Arena Web-app Agent: 1224 Elo2026-07-29
Design Arena Web-app Agent: 1224 Elo2026-07-31
Design Arena Web-app Agent: 1226 Elo2026-08-02
Design Arena Web-app Agent: 1225 Elo2026-08-01
Design Arena Web-app Agent: 1225 Elo2026-08-05
Design Arena Web-app Agent: 1221 Elo2026-08-09
Design Arena Web-app Agent: 1226 Elo2026-08-03
Design Arena Web-app Agent: 1226 Elo2026-08-04
Design Arena Web-app Agent: 1215 Elo2026-08-14
Design Arena Web-app Agent: 1225 Elo2026-08-06
Design Arena Web-app Agent: 1218 Elo2026-08-10
Design Arena Web-app Agent: 1226 Elo2026-08-07
Design Arena Web-app Agent: 1214 Elo2026-08-18
Design Arena Web-app Agent: 1226 Elo2026-08-08
Design Arena Web-app Agent: 1218 Elo2026-08-11
Design Arena Web-app Agent: 1216 Elo2026-08-15
Design Arena Web-app Agent: 1219 Elo2026-08-12
Design Arena Web-app Agent: 1216 Elo2026-08-13
Design Arena Web-app Agent: 1213 Elo2026-08-19
Design Arena Web-app Agent: 1207 Elo2026-08-27
Design Arena Web-app Agent: 1213 Elo2026-08-20
Design Arena Web-app Agent: 1217 Elo2026-08-16
Design Arena Web-app Agent: 1217 Elo2026-08-17
Design Arena Web-app Agent: 1213 Elo2026-08-21
Design Arena Web-app Agent: 1213 Elo2026-08-22
Design Arena Web-app Agent: 1213 Elo2026-08-23
Design Arena Web-app Agent: 1207 Elo2026-08-28
Design Arena Web-app Agent: 1208 Elo2026-08-24
Design Arena Web-app Agent: 1208 Elo2026-08-25
Design Arena Web-app Agent: 1209 Elo2026-08-26
Design Arena Web-app Agent: 1206 Elo2026-08-29
Design Arena Web-app Agent: 1205 Elo2026-08-30
Design Arena Web-app Agent: 1205 Elo2026-08-31
Design Arena Web-app Agent: 1205 Elo2026-09-01
Design Arena Web-app Agent: 1205 Elo2026-09-02
Design Arena Web-app Agent: 1205 Elo2026-09-03
Design Arena Web-app Agent: 1205 Elo2026-09-04
Design Arena Website: 1290 Elo2026-07-28
Design Arena Website: 1290 Elo2026-07-30
Design Arena Website: 1290 Elo2026-07-27
Design Arena Website: 1290 Elo2026-07-29
Design Arena Website: 1290 Elo2026-07-31
Design Arena Website: 1290 Elo2026-08-02
Design Arena Website: 1290 Elo2026-08-01
Design Arena Website: 1290 Elo2026-08-05
Design Arena Website: 1290 Elo2026-08-03
Design Arena Website: 1290 Elo2026-08-09
Design Arena Website: 1290 Elo2026-08-04
Design Arena Website: 1290 Elo2026-08-14
Design Arena Website: 1290 Elo2026-08-06
Design Arena Website: 1290 Elo2026-08-07
Design Arena Website: 1290 Elo2026-08-10
Design Arena Website: 1290 Elo2026-08-08
Design Arena Website: 1280 Elo2026-08-18
Design Arena Website: 1290 Elo2026-08-11
Design Arena Website: 1282 Elo2026-08-15
Design Arena Website: 1290 Elo2026-08-12
Design Arena Website: 1290 Elo2026-08-13
Design Arena Website: 1280 Elo2026-08-19
Design Arena Website: 1282 Elo2026-08-16
Design Arena Website: 1280 Elo2026-08-20
Design Arena Website: 1288 Elo2026-08-27
Design Arena Website: 1281 Elo2026-08-17
Design Arena Website: 1288 Elo2026-08-21
Design Arena Website: 1289 Elo2026-08-22
Design Arena Website: 1289 Elo2026-08-23
Design Arena Website: 1289 Elo2026-08-24
Design Arena Website: 1288 Elo2026-08-28
Design Arena Website: 1288 Elo2026-08-25
Design Arena Website: 1289 Elo2026-08-26
Design Arena Website: 1287 Elo2026-08-29
Design Arena Website: 1286 Elo2026-08-30
Design Arena Website: 1286 Elo2026-08-31
Design Arena Website: 1286 Elo2026-09-01
Design Arena Website: 1285 Elo2026-09-02
Design Arena Website: 1283 Elo2026-09-03
Design Arena Website: 1282 Elo2026-09-04
LMArena Agent: 1.22026-07-13
LMArena Agent: 1.72026-07-20
LMArena Agent: 0.72026-07-27
LMArena Agent: 1.42026-07-21
LMArena Agent: 0.42026-07-28
LMArena Agent: 0.32026-08-03
LMArena Agent: 0.62026-08-12
LMArena Agent: 0.42026-08-06
LMArena Agent: 0.52026-08-11
LMArena Agent: 0.62026-08-13
LMArena Agent: -0.42026-08-24
LMArena Agent: -0.82026-08-27
LMArena Agent: -1.42026-08-31
LMArena Creative Writing: 1456 Elo2026-07-21
LMArena Creative Writing: 1454 Elo2026-07-27
LMArena Creative Writing: 1454 Elo2026-07-30
LMArena Creative Writing: 1453 Elo2026-08-02
LMArena Creative Writing: 1453 Elo2026-08-03
LMArena Creative Writing: 1454 Elo2026-08-06
LMArena Creative Writing: 1454 Elo2026-08-12
LMArena Creative Writing: 1454 Elo2026-08-21
LMArena Creative Writing: 1454 Elo2026-08-27
LMArena Creative Writing: 1452 Elo2026-09-01
LMArena Instruction Following: 1453 Elo2026-07-21
LMArena Instruction Following: 1453 Elo2026-07-27
LMArena Instruction Following: 1453 Elo2026-07-30
LMArena Instruction Following: 1454 Elo2026-08-02
LMArena Instruction Following: 1454 Elo2026-08-03
LMArena Instruction Following: 1453 Elo2026-08-06
LMArena Instruction Following: 1451 Elo2026-08-12
LMArena Instruction Following: 1451 Elo2026-08-21
LMArena Instruction Following: 1451 Elo2026-08-27
LMArena Instruction Following: 1450 Elo2026-09-01
LMArena Long Query: 1470 Elo2026-07-21
LMArena Long Query: 1471 Elo2026-07-27
LMArena Long Query: 1471 Elo2026-07-30
LMArena Long Query: 1470 Elo2026-08-02
LMArena Long Query: 1470 Elo2026-08-03
LMArena Long Query: 1470 Elo2026-08-06
LMArena Long Query: 1468 Elo2026-08-12
LMArena Long Query: 1470 Elo2026-08-21
LMArena Long Query: 1469 Elo2026-08-27
LMArena Long Query: 1468 Elo2026-09-01
LMArena Math: 1476 Elo2026-07-21
LMArena Math: 1479 Elo2026-07-27
LMArena Math: 1479 Elo2026-07-30
LMArena Math: 1479 Elo2026-08-02
LMArena Math: 1479 Elo2026-08-03
LMArena Math: 1479 Elo2026-08-06
LMArena Math: 1478 Elo2026-08-12
LMArena Math: 1475 Elo2026-08-21
LMArena Math: 1474 Elo2026-08-27
LMArena Math: 1474 Elo2026-09-01
LMArena Text: 1466 Elo2026-07-16
LMArena Text: 1470 Elo2026-07-21
LMArena Text: 1469 Elo2026-07-27
LMArena Text: 1469 Elo2026-07-30
LMArena Text: 1469 Elo2026-08-02
LMArena Text: 1468 Elo2026-08-06
LMArena Text: 1469 Elo2026-08-03
LMArena Text: 1467 Elo2026-08-10
LMArena Text: 1468 Elo2026-08-21
LMArena Text: 1467 Elo2026-08-12
LMArena Text: 1466 Elo2026-08-27
LMArena Text: 1466 Elo2026-09-01
LMArena WebDev: 1526 Elo2026-07-16
LMArena WebDev: 1526 Elo2026-07-21
LMArena WebDev: 1525 Elo2026-07-20
LMArena WebDev: 1518 Elo2026-07-27
LMArena WebDev: 1520 Elo2026-07-24
LMArena WebDev: 1518 Elo2026-07-28
LMArena WebDev: 1518 Elo2026-07-30
LMArena WebDev: 1516 Elo2026-08-01
LMArena WebDev: 1516 Elo2026-07-31
LMArena WebDev: 1515 Elo2026-08-06
LMArena WebDev: 1516 Elo2026-08-02
LMArena WebDev: 1511 Elo2026-08-12
LMArena WebDev: 1511 Elo2026-08-10
LMArena WebDev: 1510 Elo2026-08-14
LMArena WebDev: 1509 Elo2026-08-21
LMArena WebDev: 1509 Elo2026-08-30
LMArena WebDev: 1509 Elo2026-09-01
SWE-rebench^‡: 62.7% ± 0.72026-03-01tools
SWE-rebench^‡: 50.7% ± 0.92026-05-15tools
Terminal-Bench 2.1^‡: 58.6% ± 1.22026-05-01max effort

LMArena data licensed CC-BY-4.0. Aider (Apache-2.0) and SWE-bench (MIT) are open. Design Arena uses blind human preference. ‡ Submitted scaffold plus model result. Compare the harness and effort settings, not only the model name.

Open-weight model on Hugging Face.

Task evidence

How broad is the support?

Each status is exact to this model version and the selected task. Official release claims remain provisional.

Best LLM for Frontend & UIEstablished evidence
90% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Agentic CodingEstablished evidence
72% of intended weighted task evidence across 4 independent sources. 8 of 8 configured evaluation feeds currently have results.
Best LLM for CodingEstablished evidence
68% of intended weighted task evidence across 4 independent sources. 8 of 8 configured evaluation feeds currently have results.
Best LLM for Autonomous AgentsEstablished evidence
65% of intended weighted task evidence across 3 independent sources. 7 of 7 configured evaluation feeds currently have results.
Best LLM for Hermes AgentEstablished evidence
62% of intended weighted task evidence across 3 independent sources. 5 of 5 configured evaluation feeds currently have results.
Best LLM for OpenHandsEstablished evidence
62% of intended weighted task evidence across 3 independent sources. 5 of 5 configured evaluation feeds currently have results.
Best LLM for GooseEstablished evidence
62% of intended weighted task evidence across 3 independent sources. 5 of 5 configured evaluation feeds currently have results.
Best LLM for OpenClawEstablished evidence
62% of intended weighted task evidence across 3 independent sources. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Business WritingProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Marketing CopyProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Chat & RoleplayProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Roleplay & CharacterProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Creative WritingProvisional evidence
60% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
Best LLM for WritingProvisional evidence
60% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Debugging & Code ReviewProvisional evidence
55% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Aider Polyglot or LiveBench Coding. 6 of 6 configured evaluation feeds currently have results.
Best LLM for a General AssistantProvisional evidence
55% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Logic & Problem SolvingProvisional evidence
50% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
Best LLM for AI AgentsProvisional evidence
50% of intended weighted task evidence across 3 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Agentic Coding. 7 of 7 configured evaluation feeds currently have results.
Best LLM for Code CompletionProvisional evidence
44% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Aider Polyglot or LiveBench Coding. 4 of 4 configured evaluation feeds currently have results.
Best LLM for Competition MathProvisional evidence
40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Mathematics or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
Best LLM for Math & ReasoningProvisional evidence
40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Mathematics or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
Best Local LLM for CodingProvisional evidence
40% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Aider Polyglot or LiveBench Coding. 5 of 5 configured evaluation feeds currently have results.
Best Value LLMProvisional evidence
36% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
Best Open-Weight LLM for Self-HostingProvisional evidence
33% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
Best LLM for Fast SummariesProvisional evidence
29% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
Best LLM for Literary TranslationProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 5 configured evaluation feeds currently have results.
Best Cheap LLM for High VolumeProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
Best LLM for Everyday TranslationProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 5 configured evaluation feeds currently have results.
Cheapest Capable LLMProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
Best LLM for TranslationProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 5 configured evaluation feeds currently have results.
Best LLM for Tool & Function CallingProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Search. 4 of 5 configured evaluation feeds currently have results.
Best LLM for Massive ContextProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or LongBench v2. 3 of 4 configured evaluation feeds currently have results.
Best LLM for Computer & Browser UseProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or OSWorld Verified. 4 of 4 configured evaluation feeds currently have results.
Best LLM for Document SummarizationProvisional evidence
20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LiveBench Instruction Following. 4 of 6 configured evaluation feeds currently have results.
Best LLM for SummarizationProvisional evidence
20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LiveBench Instruction Following. 4 of 6 configured evaluation feeds currently have results.
Best LLM for RAG & Long ContextProvisional evidence
18% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LMArena Document. 4 of 6 configured evaluation feeds currently have results.
Best LLM for JSON & Schema OutputProvisional evidence
17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Data Analysis. 4 of 5 configured evaluation feeds currently have results.
Best LLM for Structured Data ExtractionProvisional evidence
17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Data Analysis. 4 of 5 configured evaluation feeds currently have results.
Best LLM for High-Volume ExtractionProvisional evidence
13% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LiveBench Data Analysis or Route reliability. 2 of 4 configured evaluation feeds currently have results.
Best LLM for OCR & DocumentsProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LMArena Document or LMArena Vision. 3 of 5 configured evaluation feeds currently have results.
Best LLM for Image UnderstandingProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LiveBench Reasoning or LMArena Vision. 3 of 4 configured evaluation feeds currently have results.
Best LLM for Vision & DocumentsProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LMArena Document or LMArena Vision. 3 of 5 configured evaluation feeds currently have results.
Best LLM for Grounded RAGProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from CRAG or FACTS Grounding. 2 of 5 configured evaluation feeds currently have results.
Best LLM for Charts & DiagramsProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LMArena Document or LMArena Vision. 3 of 5 configured evaluation feeds currently have results.
Best LLM for Document ParsingProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LMArena Document or LMArena Vision. 3 of 5 configured evaluation feeds currently have results.

Recommendation coverage

Where this model appears

Not currently included in a published recommendation. The task evidence panel above says exactly what is confirmed and what is still missing.

Catalog data via OpenRouter and models.dev. Last checked within the past 6 hours.