o3

openai/o3-2025-04-16

OpenAI: o3 is a model that processes image, text, and file inputs to generate text outputs. It has a context length of 200,000 tokens, supports tools and reasoning, and is not open-weight. Pricing is $2 per million input tokens and $8 per million output tokens.

  • tool use
  • structured outputs
  • reasoning

At a glance

provideropenai
releasedJun 1, 2024
context200K
input / M$2

Specifications

What the API gives you

Context window
200K tokens
Max output
100K tokens
Input price
$2 / 1M tokens
Output price
$8 / 1M tokens
Cache read
$0.50 / 1M tokens
Modalities
image, text, file → text
Knowledge cutoff
Jun 30, 2024
Released
Jun 1, 2024

Measured evidence

Public benchmark record

Aider Polyglot
81.3%2026-10-21
BFCL
63.0%2026-10-21
Design Arena Coding
1021 Elo2026-10-21
Design Arena UI
1016 Elo2026-10-21
Design Arena Website
1036 Elo2026-10-21
FACTS Grounding
36.2%2025-09-03evaluated 2025-09-03
FrontierMath Tiers 1-3 (Epoch AI)‡
33.3% ± 2.82026-08-27high effort, evaluated 2026-08-27
GPQA Diamond (Epoch AI)‡
80.8% ± 2.82026-08-07medium effort, evaluated 2026-08-07
GPQA Diamond (Epoch AI)‡
79.8% ± 2.92026-07-15low effort, evaluated 2026-07-15
GPQA Diamond (Epoch AI)‡
81.8% ± 2.12025-04-16high effort, evaluated 2025-04-16
LMArena Creative Writing
1359 Elo2026-10-20
LMArena Instruction Following
1368 Elo2026-10-20
LMArena Long Query
1372 Elo2026-10-20
LMArena Math
1426 Elo2026-10-20
LMArena Text
1432 Elo2026-10-20
LMArena Text Factuality
1404 Elo2026-10-20
LMArena Vision
1216 Elo2026-10-19
LMArena Vision Diagrams
1233 Elo2026-10-19
LMArena Vision OCR
1226 Elo2026-10-19
OTIS Mock AIME (Epoch AI)‡
84.4% ± 5.52026-08-07medium effort, evaluated 2026-08-07
OTIS Mock AIME (Epoch AI)‡
60% ± 7.42026-07-15low effort, evaluated 2026-07-15
OTIS Mock AIME (Epoch AI)‡
83.9% ± 4.42025-04-16high effort, evaluated 2025-04-16
SimpleQA Verified (Epoch AI)‡
49.4% ± 1.62026-08-27high effort, evaluated 2026-08-27

LMArena data licensed CC-BY-4.0. Aider (Apache-2.0) and SWE-bench (MIT) are open. Design Arena uses blind human preference. ‡ Submitted scaffold plus model result. Compare the harness and effort settings, not only the model name.

Task evidence

How broad is the support?

Each status is exact to this model version and the selected task. Official release claims remain provisional.

  • Best LLM for Grounded RAGEstablished evidence

    62% of intended weighted task evidence across 3 independent sources. 5 of 7 configured evaluation feeds currently have results.

  • Best LLM for a General AssistantEstablished evidence

    59% of intended weighted task evidence across 2 independent sources. 6 of 6 configured evaluation feeds currently have results.

  • Best LLM for Competition MathEstablished evidence

    56% of intended weighted task evidence across 3 independent sources. 6 of 6 configured evaluation feeds currently have results.

  • Best LLM for Logic & Problem SolvingEstablished evidence

    55% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.

  • Best LLM for Math & ReasoningEstablished evidence

    52% of intended weighted task evidence across 4 independent sources. 7 of 7 configured evaluation feeds currently have results.

  • Best LLM for Document SummarizationEstablished evidence

    45% of intended weighted task evidence across 2 independent sources. 5 of 6 configured evaluation feeds currently have results.

Show all 42 tasks
  • Best LLM for SummarizationEstablished evidence

    45% of intended weighted task evidence across 2 independent sources. 5 of 6 configured evaluation feeds currently have results.

  • Best LLM for RAG & Long ContextEstablished evidence

    44% of intended weighted task evidence across 2 independent sources. 5 of 6 configured evaluation feeds currently have results.

  • Best LLM for JSON & Schema OutputEstablished evidence

    29% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for Structured Data ExtractionEstablished evidence

    29% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for CodingEstablished evidence

    27% of intended weighted task evidence across 2 independent sources. 7 of 7 configured evaluation feeds currently have results.

  • Best LLM for Business WritingProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Marketing CopyProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Chat & RoleplayProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Roleplay & CharacterProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Creative WritingProvisional evidence

    56% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for WritingProvisional evidence

    56% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Frontend & UIProvisional evidence

    55% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Coding or LMArena WebDev. 6 of 6 configured evaluation feeds currently have results.

  • Best LLM for Image UnderstandingProvisional evidence

    50% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Reasoning or VLMEvalKit tasks. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for OCR & DocumentsProvisional evidence

    45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.

  • Best LLM for Charts & DiagramsProvisional evidence

    45% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.

  • Best LLM for Vision & DocumentsProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 4 of 6 configured evaluation feeds currently have results.

  • Best LLM for Hermes AgentProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for OpenHandsProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for GooseProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for OpenClawProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best Local LLM for CodingProvisional evidence

    38% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Coding or LMArena WebDev. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Document ParsingProvisional evidence

    37% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.

  • Best Open-Weight LLM for Self-HostingProvisional evidence

    27% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Tool & Function CallingProvisional evidence

    25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or LMArena Agent Steerability. 6 of 7 configured evaluation feeds currently have results.

  • Best Value LLMProvisional evidence

    25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Debugging & Code ReviewProvisional evidence

    22% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Coding or LMArena WebDev. 5 of 5 configured evaluation feeds currently have results.

  • Best LLM for Code CompletionProvisional evidence

    21% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Coding or LMArena WebDev. 3 of 3 configured evaluation feeds currently have results.

  • Best LLM for Massive ContextProvisional evidence

    20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or LongBench v2. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for AI AgentsProvisional evidence

    18% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Agentic Coding or LMArena Agent. 9 of 9 configured evaluation feeds currently have results.

  • Best LLM for Fast SummariesProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Literary TranslationProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for Everyday TranslationProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for TranslationProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for Computer & Browser UseProvisional evidence

    11% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or OSWorld Verified. 3 of 3 configured evaluation feeds currently have results.

  • Best Cheap LLM for High VolumeProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Cheapest Capable LLMProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

Recommendation coverage

Where this model appears

Not currently included in a published recommendation. The task evidence panel above says exactly what is confirmed and what is still missing.

Catalog data via OpenRouter and models.dev. Last checked within the past 6 hours.