Muse Spark 1.1
meta/muse-spark-1.1-20260709
Meta's Muse Spark 1.1 model, provided by Meta, accepts text, image, video, file, and audio inputs and generates text output. It operates with a context window of 1,048,576 tokens, charges 1.25 currency units per
- tool use
- structured outputs
- reasoning
At a glance
Specifications
What the API gives you
- Context window
- 1.0M tokens
- Max output
- 944K tokens
- Input price
- $1.25 / 1M tokens
- Output price
- $4.25 / 1M tokens
- Cache read
- $0.15 / 1M tokens
- Modalities
- text, image, video, file, audio → text
- Knowledge cutoff
- —
- Released
- Apr 8, 2026
Measured evidence
Public benchmark record
- Design Arena Coding
- 1302 Elo2026-07-28
- Design Arena Coding
- 1302 Elo2026-07-27
- Design Arena Coding
- 1304 Elo2026-07-30
- Design Arena Coding
- 1303 Elo2026-07-29
- Design Arena Coding
- 1304 Elo2026-07-31
- Design Arena Coding
- 1303 Elo2026-08-02
- Design Arena Coding
- 1308 Elo2026-08-05
- Design Arena Coding
- 1303 Elo2026-08-01
- Design Arena Coding
- 1308 Elo2026-08-09
- Design Arena Coding
- 1303 Elo2026-08-03
- Design Arena Coding
- 1309 Elo2026-08-04
- Design Arena Coding
- 1305 Elo2026-08-14
- Design Arena Coding
- 1309 Elo2026-08-06
- Design Arena Coding
- 1308 Elo2026-08-10
- Design Arena Coding
- 1309 Elo2026-08-07
- Design Arena Coding
- 1298 Elo2026-08-18
- Design Arena Coding
- 1308 Elo2026-08-08
- Design Arena Coding
- 1302 Elo2026-08-21
- Design Arena Coding
- 1298 Elo2026-08-15
- Design Arena Coding
- 1308 Elo2026-08-11
- Design Arena Coding
- 1308 Elo2026-08-12
- Design Arena Coding
- 1297 Elo2026-08-19
- Design Arena Coding
- 1306 Elo2026-08-13
- Design Arena Coding
- 1301 Elo2026-08-27
- Design Arena Coding
- 1297 Elo2026-08-20
- Design Arena Coding
- 1298 Elo2026-08-16
- Design Arena Coding
- 1298 Elo2026-08-17
- Design Arena Coding
- 1303 Elo2026-08-22
- Design Arena Coding
- 1303 Elo2026-08-23
- Design Arena Coding
- 1300 Elo2026-08-28
- Design Arena Coding
- 1303 Elo2026-08-24
- Design Arena Coding
- 1302 Elo2026-08-25
- Design Arena Coding
- 1302 Elo2026-08-26
- Design Arena Coding
- 1300 Elo2026-08-29
- Design Arena Coding
- 1300 Elo2026-08-30
- Design Arena Coding
- 1300 Elo2026-08-31
- Design Arena Coding
- 1300 Elo2026-09-01
- Design Arena Coding
- 1299 Elo2026-09-02
- Design Arena Coding
- 1297 Elo2026-09-03
- Design Arena Coding
- 1296 Elo2026-09-04
- Design Arena Full-stack Agent
- 1246 Elo2026-08-14
- Design Arena Full-stack Agent
- 1240 Elo2026-08-18
- Design Arena Full-stack Agent
- 1249 Elo2026-08-15
- Design Arena Full-stack Agent
- 1257 Elo2026-08-13
- Design Arena Full-stack Agent
- 1240 Elo2026-08-19
- Design Arena Full-stack Agent
- 1232 Elo2026-08-27
- Design Arena Full-stack Agent
- 1240 Elo2026-08-20
- Design Arena Full-stack Agent
- 1244 Elo2026-08-16
- Design Arena Full-stack Agent
- 1245 Elo2026-08-17
- Design Arena Full-stack Agent
- 1243 Elo2026-08-21
- Design Arena Full-stack Agent
- 1244 Elo2026-08-22
- Design Arena Full-stack Agent
- 1243 Elo2026-08-23
- Design Arena Full-stack Agent
- 1230 Elo2026-08-28
- Design Arena Full-stack Agent
- 1229 Elo2026-08-24
- Design Arena Full-stack Agent
- 1231 Elo2026-08-25
- Design Arena Full-stack Agent
- 1231 Elo2026-08-26
- Design Arena Full-stack Agent
- 1231 Elo2026-08-29
- Design Arena Full-stack Agent
- 1232 Elo2026-08-30
- Design Arena Full-stack Agent
- 1230 Elo2026-08-31
- Design Arena Full-stack Agent
- 1230 Elo2026-09-01
- Design Arena Full-stack Agent
- 1231 Elo2026-09-02
- Design Arena Full-stack Agent
- 1232 Elo2026-09-03
- Design Arena Full-stack Agent
- 1231 Elo2026-09-04
- Design Arena UI
- 1310 Elo2026-07-28
- Design Arena UI
- 1310 Elo2026-07-27
- Design Arena UI
- 1317 Elo2026-07-30
- Design Arena UI
- 1309 Elo2026-07-29
- Design Arena UI
- 1316 Elo2026-07-31
- Design Arena UI
- 1320 Elo2026-08-02
- Design Arena UI
- 1319 Elo2026-08-01
- Design Arena UI
- 1334 Elo2026-08-05
- Design Arena UI
- 1329 Elo2026-08-09
- Design Arena UI
- 1321 Elo2026-08-03
- Design Arena UI
- 1334 Elo2026-08-04
- Design Arena UI
- 1327 Elo2026-08-14
- Design Arena UI
- 1334 Elo2026-08-06
- Design Arena UI
- 1331 Elo2026-08-07
- Design Arena UI
- 1329 Elo2026-08-10
- Design Arena UI
- 1329 Elo2026-08-08
- Design Arena UI
- 1321 Elo2026-08-18
- Design Arena UI
- 1329 Elo2026-08-11
- Design Arena UI
- 1323 Elo2026-08-15
- Design Arena UI
- 1331 Elo2026-08-12
- Design Arena UI
- 1330 Elo2026-08-13
- Design Arena UI
- 1321 Elo2026-08-19
- Design Arena UI
- 1318 Elo2026-08-27
- Design Arena UI
- 1322 Elo2026-08-16
- Design Arena UI
- 1321 Elo2026-08-20
- Design Arena UI
- 1321 Elo2026-08-17
- Design Arena UI
- 1319 Elo2026-08-21
- Design Arena UI
- 1321 Elo2026-08-22
- Design Arena UI
- 1321 Elo2026-08-23
- Design Arena UI
- 1317 Elo2026-08-28
- Design Arena UI
- 1321 Elo2026-08-24
- Design Arena UI
- 1320 Elo2026-08-25
- Design Arena UI
- 1319 Elo2026-08-26
- Design Arena UI
- 1316 Elo2026-08-29
- Design Arena UI
- 1315 Elo2026-08-30
- Design Arena UI
- 1315 Elo2026-08-31
- Design Arena UI
- 1316 Elo2026-09-01
- Design Arena UI
- 1316 Elo2026-09-02
- Design Arena UI
- 1315 Elo2026-09-03
- Design Arena UI
- 1313 Elo2026-09-04
- Design Arena Web-app Agent
- 1254 Elo2026-07-28
- Design Arena Web-app Agent
- 1255 Elo2026-07-27
- Design Arena Web-app Agent
- 1254 Elo2026-07-30
- Design Arena Web-app Agent
- 1254 Elo2026-07-29
- Design Arena Web-app Agent
- 1253 Elo2026-07-31
- Design Arena Web-app Agent
- 1255 Elo2026-08-02
- Design Arena Web-app Agent
- 1254 Elo2026-08-01
- Design Arena Web-app Agent
- 1254 Elo2026-08-05
- Design Arena Web-app Agent
- 1246 Elo2026-08-09
- Design Arena Web-app Agent
- 1255 Elo2026-08-03
- Design Arena Web-app Agent
- 1255 Elo2026-08-04
- Design Arena Web-app Agent
- 1240 Elo2026-08-14
- Design Arena Web-app Agent
- 1254 Elo2026-08-06
- Design Arena Web-app Agent
- 1243 Elo2026-08-10
- Design Arena Web-app Agent
- 1254 Elo2026-08-07
- Design Arena Web-app Agent
- 1239 Elo2026-08-18
- Design Arena Web-app Agent
- 1254 Elo2026-08-08
- Design Arena Web-app Agent
- 1243 Elo2026-08-11
- Design Arena Web-app Agent
- 1237 Elo2026-08-15
- Design Arena Web-app Agent
- 1244 Elo2026-08-12
- Design Arena Web-app Agent
- 1242 Elo2026-08-13
- Design Arena Web-app Agent
- 1239 Elo2026-08-19
- Design Arena Web-app Agent
- 1234 Elo2026-08-27
- Design Arena Web-app Agent
- 1239 Elo2026-08-20
- Design Arena Web-app Agent
- 1241 Elo2026-08-16
- Design Arena Web-app Agent
- 1242 Elo2026-08-17
- Design Arena Web-app Agent
- 1238 Elo2026-08-21
- Design Arena Web-app Agent
- 1239 Elo2026-08-22
- Design Arena Web-app Agent
- 1240 Elo2026-08-23
- Design Arena Web-app Agent
- 1236 Elo2026-08-28
- Design Arena Web-app Agent
- 1235 Elo2026-08-24
- Design Arena Web-app Agent
- 1235 Elo2026-08-25
- Design Arena Web-app Agent
- 1235 Elo2026-08-26
- Design Arena Web-app Agent
- 1235 Elo2026-08-29
- Design Arena Web-app Agent
- 1234 Elo2026-08-30
- Design Arena Web-app Agent
- 1234 Elo2026-08-31
- Design Arena Web-app Agent
- 1234 Elo2026-09-01
- Design Arena Web-app Agent
- 1234 Elo2026-09-02
- Design Arena Web-app Agent
- 1234 Elo2026-09-03
- Design Arena Web-app Agent
- 1234 Elo2026-09-04
- Design Arena Website
- 1292 Elo2026-07-28
- Design Arena Website
- 1296 Elo2026-07-30
- Design Arena Website
- 1291 Elo2026-07-27
- Design Arena Website
- 1295 Elo2026-07-29
- Design Arena Website
- 1295 Elo2026-07-31
- Design Arena Website
- 1296 Elo2026-08-02
- Design Arena Website
- 1295 Elo2026-08-01
- Design Arena Website
- 1295 Elo2026-08-05
- Design Arena Website
- 1295 Elo2026-08-03
- Design Arena Website
- 1295 Elo2026-08-09
- Design Arena Website
- 1296 Elo2026-08-04
- Design Arena Website
- 1292 Elo2026-08-14
- Design Arena Website
- 1295 Elo2026-08-06
- Design Arena Website
- 1296 Elo2026-08-07
- Design Arena Website
- 1296 Elo2026-08-10
- Design Arena Website
- 1295 Elo2026-08-08
- Design Arena Website
- 1284 Elo2026-08-18
- Design Arena Website
- 1296 Elo2026-08-11
- Design Arena Website
- 1284 Elo2026-08-15
- Design Arena Website
- 1295 Elo2026-08-12
- Design Arena Website
- 1293 Elo2026-08-13
- Design Arena Website
- 1284 Elo2026-08-19
- Design Arena Website
- 1283 Elo2026-08-16
- Design Arena Website
- 1284 Elo2026-08-20
- Design Arena Website
- 1289 Elo2026-08-27
- Design Arena Website
- 1284 Elo2026-08-17
- Design Arena Website
- 1291 Elo2026-08-21
- Design Arena Website
- 1292 Elo2026-08-22
- Design Arena Website
- 1291 Elo2026-08-23
- Design Arena Website
- 1290 Elo2026-08-24
- Design Arena Website
- 1289 Elo2026-08-28
- Design Arena Website
- 1289 Elo2026-08-25
- Design Arena Website
- 1289 Elo2026-08-26
- Design Arena Website
- 1288 Elo2026-08-29
- Design Arena Website
- 1288 Elo2026-08-30
- Design Arena Website
- 1287 Elo2026-08-31
- Design Arena Website
- 1288 Elo2026-09-01
- Design Arena Website
- 1286 Elo2026-09-02
- Design Arena Website
- 1284 Elo2026-09-03
- Design Arena Website
- 1284 Elo2026-09-04
- LiveBench Agentic Coding
- 58.5%2026-06-25
- LiveBench Coding
- 77.2%2026-06-25
- LiveBench Data Analysis
- 72.5%2026-06-25
- LiveBench Instruction Following
- 69.6%2026-06-25
- LiveBench Language
- 74.3%2026-06-25
- LiveBench Math
- 87.1%2026-06-25
- LiveBench Reasoning
- 87.7%2026-06-25
- LMArena Agent
- 1.22026-07-20
- LMArena Agent
- 0.82026-07-27
- LMArena Agent
- 0.72026-07-21
- LMArena Agent
- 0.72026-07-28
- LMArena Agent
- 0.62026-08-03
- LMArena Agent
- 1.12026-08-12
- LMArena Agent
- 0.92026-08-06
- LMArena Agent
- 1.12026-08-11
- LMArena Agent
- 1.22026-08-13
- LMArena Agent
- -0.12026-08-24
- LMArena Agent
- -0.22026-08-27
- LMArena Agent
- -0.72026-08-31
- LMArena Creative Writing
- 1449 Elo2026-07-21
- LMArena Creative Writing
- 1440 Elo2026-07-27
- LMArena Creative Writing
- 1440 Elo2026-07-30
- LMArena Creative Writing
- 1439 Elo2026-08-02
- LMArena Creative Writing
- 1439 Elo2026-08-03
- LMArena Creative Writing
- 1437 Elo2026-08-06
- LMArena Creative Writing
- 1436 Elo2026-08-12
- LMArena Creative Writing
- 1438 Elo2026-08-21
- LMArena Creative Writing
- 1435 Elo2026-08-27
- LMArena Creative Writing
- 1437 Elo2026-09-01
- LMArena Instruction Following
- 1465 Elo2026-07-21
- LMArena Instruction Following
- 1461 Elo2026-07-27
- LMArena Instruction Following
- 1461 Elo2026-07-30
- LMArena Instruction Following
- 1461 Elo2026-08-02
- LMArena Instruction Following
- 1461 Elo2026-08-03
- LMArena Instruction Following
- 1461 Elo2026-08-06
- LMArena Instruction Following
- 1460 Elo2026-08-12
- LMArena Instruction Following
- 1457 Elo2026-08-21
- LMArena Instruction Following
- 1455 Elo2026-08-27
- LMArena Instruction Following
- 1455 Elo2026-09-01
- LMArena Long Query
- 1464 Elo2026-07-21
- LMArena Long Query
- 1463 Elo2026-07-27
- LMArena Long Query
- 1463 Elo2026-07-30
- LMArena Long Query
- 1461 Elo2026-08-02
- LMArena Long Query
- 1461 Elo2026-08-03
- LMArena Long Query
- 1458 Elo2026-08-06
- LMArena Long Query
- 1460 Elo2026-08-12
- LMArena Long Query
- 1459 Elo2026-08-21
- LMArena Long Query
- 1460 Elo2026-08-27
- LMArena Long Query
- 1461 Elo2026-09-01
- LMArena Math
- 1473 Elo2026-07-21
- LMArena Math
- 1471 Elo2026-07-27
- LMArena Math
- 1471 Elo2026-07-30
- LMArena Math
- 1477 Elo2026-08-02
- LMArena Math
- 1477 Elo2026-08-03
- LMArena Math
- 1475 Elo2026-08-06
- LMArena Math
- 1476 Elo2026-08-12
- LMArena Math
- 1477 Elo2026-08-21
- LMArena Math
- 1476 Elo2026-08-27
- LMArena Math
- 1477 Elo2026-09-01
- LMArena Text
- 1481 Elo2026-07-16
- LMArena Text
- 1491 Elo2026-07-20
- LMArena Text
- 1495 Elo2026-07-21
- LMArena Text
- 1491 Elo2026-07-27
- LMArena Text
- 1491 Elo2026-07-30
- LMArena Text
- 1490 Elo2026-08-02
- LMArena Text
- 1487 Elo2026-08-06
- LMArena Text
- 1490 Elo2026-08-03
- LMArena Text
- 1489 Elo2026-08-12
- LMArena Text
- 1489 Elo2026-08-10
- LMArena Text
- 1491 Elo2026-08-21
- LMArena Text
- 1490 Elo2026-08-27
- LMArena Text
- 1492 Elo2026-09-01
- LMArena Vision
- 1283 Elo2026-07-26
- LMArena Vision
- 1283 Elo2026-07-30
- LMArena Vision
- 1283 Elo2026-08-02
- LMArena Vision
- 1282 Elo2026-08-06
- LMArena Vision
- 1281 Elo2026-08-21
- LMArena Vision
- 1279 Elo2026-08-27
- LMArena WebDev
- 1538 Elo2026-07-16
- LMArena WebDev
- 1539 Elo2026-07-21
- LMArena WebDev
- 1540 Elo2026-07-20
- LMArena WebDev
- 1537 Elo2026-07-27
- LMArena WebDev
- 1536 Elo2026-07-24
- LMArena WebDev
- 1536 Elo2026-07-28
- LMArena WebDev
- 1536 Elo2026-07-30
- LMArena WebDev
- 1536 Elo2026-08-01
- LMArena WebDev
- 1535 Elo2026-07-31
- LMArena WebDev
- 1536 Elo2026-08-06
- LMArena WebDev
- 1536 Elo2026-08-02
- LMArena WebDev
- 1539 Elo2026-08-12
- LMArena WebDev
- 1537 Elo2026-08-10
- LMArena WebDev
- 1538 Elo2026-08-14
- LMArena WebDev
- 1539 Elo2026-08-21
- LMArena WebDev
- 1540 Elo2026-08-30
- LMArena WebDev
- 1540 Elo2026-09-01
- Terminal-Bench 2.1‡
- 76.2% ± 1.22026-07-09xhigh effort
LMArena data licensed CC-BY-4.0. Aider (Apache-2.0) and SWE-bench (MIT) are open. Design Arena uses blind human preference. ‡ Submitted scaffold plus model result. Compare the harness and effort settings, not only the model name.
Task evidence
How broad is the support?
Each status is exact to this model version and the selected task. Official release claims remain provisional.
- Best LLM for Competition MathEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Business WritingEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Logic & Problem SolvingEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Marketing CopyEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Chat & RoleplayEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Creative WritingEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Frontend & UIEstablished evidence
100% of intended weighted task evidence across 3 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for WritingEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Roleplay & CharacterEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Math & ReasoningEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for a General AssistantEstablished evidence
100% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Code CompletionEstablished evidence
81% of intended weighted task evidence across 2 independent sources. 4 of 4 configured evaluation feeds currently have results.
- Best LLM for CodingEstablished evidence
68% of intended weighted task evidence across 4 independent sources. 8 of 8 configured evaluation feeds currently have results.
- Best LLM for Agentic CodingEstablished evidence
68% of intended weighted task evidence across 4 independent sources. 8 of 8 configured evaluation feeds currently have results.
- Best Open-Weight LLM for Self-HostingEstablished evidence
67% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Image UnderstandingEstablished evidence
65% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Fast SummariesEstablished evidence
64% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.
- Best Value LLMEstablished evidence
64% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Document SummarizationEstablished evidence
60% of intended weighted task evidence across 2 independent sources. 4 of 6 configured evaluation feeds currently have results.
- Best LLM for SummarizationEstablished evidence
60% of intended weighted task evidence across 2 independent sources. 4 of 6 configured evaluation feeds currently have results.
- Best LLM for Literary TranslationProvisional evidence
55% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from WMT translation. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Everyday TranslationProvisional evidence
55% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from WMT translation. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for TranslationProvisional evidence
55% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from WMT translation. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Autonomous AgentsProvisional evidence
53% of intended weighted task evidence across 3 independent sources; broader independent confirmation is still missing from Frontier-Bench or OSWorld Verified. 7 of 7 configured evaluation feeds currently have results.
- Best LLM for Hermes AgentProvisional evidence
51% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or SWE-rebench. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for OpenHandsProvisional evidence
51% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or SWE-rebench. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for GooseProvisional evidence
51% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or SWE-rebench. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for OpenClawProvisional evidence
51% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or SWE-rebench. 5 of 5 configured evaluation feeds currently have results.
- Best Cheap LLM for High VolumeProvisional evidence
50% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Cheapest Capable LLMProvisional evidence
50% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Massive ContextProvisional evidence
50% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LongBench v2. 3 of 4 configured evaluation feeds currently have results.
- Best Local LLM for CodingProvisional evidence
50% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Aider Polyglot or SWE-rebench. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for OCR & DocumentsProvisional evidence
45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Structured-output eval or VLMEvalKit tasks. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Vision & DocumentsProvisional evidence
45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Structured-output eval or VLMEvalKit tasks. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Charts & DiagramsProvisional evidence
45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Structured-output eval or VLMEvalKit tasks. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Document ParsingProvisional evidence
45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Structured-output eval or VLMEvalKit tasks. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for AI AgentsProvisional evidence
45% of intended weighted task evidence across 3 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or OSWorld Verified. 7 of 7 configured evaluation feeds currently have results.
- Best LLM for Debugging & Code ReviewProvisional evidence
40% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Aider Polyglot or SWE-bench Verified. 6 of 6 configured evaluation feeds currently have results.
- Best LLM for JSON & Schema OutputProvisional evidence
39% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or Structured-output eval. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Structured Data ExtractionProvisional evidence
39% of intended weighted task evidence across 2 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or Structured-output eval. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for RAG & Long ContextProvisional evidence
35% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LMArena Search. 4 of 6 configured evaluation feeds currently have results.
- Best LLM for High-Volume ExtractionProvisional evidence
31% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Route reliability or Structured-output eval. 2 of 4 configured evaluation feeds currently have results.
- Best LLM for Tool & Function CallingProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Search. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Computer & Browser UseProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or OSWorld Verified. 4 of 4 configured evaluation feeds currently have results.
- Best LLM for Grounded RAGProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from CRAG or FACTS Grounding. 2 of 5 configured evaluation feeds currently have results.
Recommendation coverage
Where this model appears
Not currently included in a published recommendation. The task evidence panel above says exactly what is confirmed and what is still missing.
Catalog data via OpenRouter and models.dev. Last checked within the past 6 hours.