Mistral Small 3.1 24B

mistralai/mistral-small-3.1-24b-instruct-2503

This model processes text and image inputs to generate text outputs. It supports a context length of 128,000 tokens and includes tool use capabilities. Pricing is $0.351 per million input tokens and $0.555 per million output tokens, and it is an open-weight model.

  • tool use
  • structured outputs
  • open-weight

At a glance

providermistralai
releasedMar 17, 2025
context128K
input / M$0.35

Specifications

What the API gives you

Context window
128K tokens
Max output
102K tokens
Input price
$0.35 / 1M tokens
Output price
$0.55 / 1M tokens
Cache read
—
Modalities
text, image → text
Knowledge cutoff
Oct 31, 2023
Released
Mar 17, 2025

Measured evidence

Public benchmark record

FACTS Grounding
43.3%2025-11-13evaluated 2025-11-13
LMArena Creative Writing
1252 Elo2026-10-20
LMArena Long Query
1299 Elo2026-10-20
LMArena Math
1261 Elo2026-10-20
LMArena Text
1303 Elo2026-10-20
LMArena Vision
1127 Elo2026-10-19
LMArena Vision Diagrams
1129 Elo2026-10-19
LMArena Vision OCR
1134 Elo2026-10-19

LMArena data licensed CC-BY-4.0. Aider (Apache-2.0) and SWE-bench (MIT) are open. Design Arena uses blind human preference.

Open-weight model on Hugging Face.

Task evidence

How broad is the support?

Each status is exact to this model version and the selected task. Official release claims remain provisional.

  • 35% of intended weighted task evidence across 2 independent sources. 5 of 6 configured evaluation feeds currently have results.

  • Best LLM for SummarizationEstablished evidence

    35% of intended weighted task evidence across 2 independent sources. 5 of 6 configured evaluation feeds currently have results.

  • 33% of intended weighted task evidence across 2 independent sources. 5 of 6 configured evaluation feeds currently have results.

  • Best LLM for Business WritingProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Marketing CopyProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Chat & RoleplayProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

Show all 30 tasks
  • 67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Creative WritingProvisional evidence

    56% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for WritingProvisional evidence

    56% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • 50% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Reasoning or VLMEvalKit tasks. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for OCR & DocumentsProvisional evidence

    45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.

  • Best LLM for Charts & DiagramsProvisional evidence

    45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.

  • 41% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from SimpleQA Verified (Epoch AI) or LiveBench Instruction Following. 6 of 6 configured evaluation feeds currently have results.

  • 40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 4 of 6 configured evaluation feeds currently have results.

  • Best LLM for Document ParsingProvisional evidence

    37% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.

  • 36% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from GPQA Diamond (Epoch AI) or LiveBench Instruction Following. 5 of 5 configured evaluation feeds currently have results.

  • Best LLM for Grounded RAGProvisional evidence

    33% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from CRAG or SimpleQA Verified (Epoch AI). 5 of 7 configured evaluation feeds currently have results.

  • Best LLM for Math & ReasoningProvisional evidence

    28% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FrontierMath Tiers 1-3 (Epoch AI) or GPQA Diamond (Epoch AI). 7 of 7 configured evaluation feeds currently have results.

  • 27% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Competition MathProvisional evidence

    26% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FrontierMath Tiers 1-3 (Epoch AI) or OTIS Mock AIME (Epoch AI). 6 of 6 configured evaluation feeds currently have results.

  • Best Value LLMProvisional evidence

    25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Massive ContextProvisional evidence

    20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or LongBench v2. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Fast SummariesProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • 17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • 17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for TranslationProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • 12% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Data Analysis. 3 of 4 configured evaluation feeds currently have results.

  • 12% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Data Analysis. 3 of 4 configured evaluation feeds currently have results.

  • Best Cheap LLM for High VolumeProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Cheapest Capable LLMProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

Recommendation coverage

Where this model appears

Not currently included in a published recommendation. The task evidence panel above says exactly what is confirmed and what is still missing.

Catalog data via OpenRouter and models.dev. Last checked within the past 6 hours.