GPT-4o (2024-05-13)
openai/gpt-4o-2024-05-13
This model accepts text, image, and file inputs and generates text outputs. It has a context length of 128,000 tokens and supports tool use.
- tool use
- structured outputs
At a glance
Specifications
What the API gives you
- Context window
- 128K tokens
- Max output
- 4K tokens
- Input price
- $5 / 1M tokens
- Output price
- $15 / 1M tokens
- Cache read
- —
- Modalities
- text, image, file → text
- Knowledge cutoff
- Oct 31, 2023
- Released
- May 13, 2024
Measured evidence
Public benchmark record
- LMArena Creative Writing
- 1292 Elo2026-07-21
- LMArena Creative Writing
- 1292 Elo2026-07-27
- LMArena Creative Writing
- 1292 Elo2026-07-30
- LMArena Creative Writing
- 1292 Elo2026-08-02
- LMArena Creative Writing
- 1292 Elo2026-08-03
- LMArena Creative Writing
- 1292 Elo2026-08-06
- LMArena Creative Writing
- 1291 Elo2026-08-12
- LMArena Creative Writing
- 1291 Elo2026-08-21
- LMArena Creative Writing
- 1291 Elo2026-09-02
- LMArena Creative Writing
- 1291 Elo2026-08-27
- LMArena Creative Writing
- 1291 Elo2026-09-01
- LMArena Instruction Following
- 1278 Elo2026-07-21
- LMArena Instruction Following
- 1278 Elo2026-07-27
- LMArena Instruction Following
- 1278 Elo2026-07-30
- LMArena Instruction Following
- 1278 Elo2026-08-02
- LMArena Instruction Following
- 1278 Elo2026-08-03
- LMArena Instruction Following
- 1278 Elo2026-08-06
- LMArena Instruction Following
- 1278 Elo2026-08-12
- LMArena Instruction Following
- 1278 Elo2026-08-21
- LMArena Instruction Following
- 1278 Elo2026-09-02
- LMArena Instruction Following
- 1278 Elo2026-08-27
- LMArena Instruction Following
- 1278 Elo2026-09-01
- LMArena Long Query
- 1289 Elo2026-07-21
- LMArena Long Query
- 1289 Elo2026-07-27
- LMArena Long Query
- 1289 Elo2026-07-30
- LMArena Long Query
- 1289 Elo2026-08-02
- LMArena Long Query
- 1289 Elo2026-08-03
- LMArena Long Query
- 1289 Elo2026-08-06
- LMArena Long Query
- 1288 Elo2026-08-12
- LMArena Long Query
- 1288 Elo2026-08-21
- LMArena Long Query
- 1288 Elo2026-09-02
- LMArena Long Query
- 1288 Elo2026-08-27
- LMArena Long Query
- 1288 Elo2026-09-01
- LMArena Math
- 1284 Elo2026-07-21
- LMArena Math
- 1284 Elo2026-07-27
- LMArena Math
- 1284 Elo2026-07-30
- LMArena Math
- 1284 Elo2026-08-02
- LMArena Math
- 1284 Elo2026-08-03
- LMArena Math
- 1284 Elo2026-08-06
- LMArena Math
- 1284 Elo2026-08-12
- LMArena Math
- 1284 Elo2026-08-21
- LMArena Math
- 1284 Elo2026-09-01
- LMArena Math
- 1284 Elo2026-08-27
- LMArena Text
- 1346 Elo2026-07-21
- LMArena Text
- 1346 Elo2026-07-27
- LMArena Text
- 1346 Elo2026-07-30
- LMArena Text
- 1346 Elo2026-08-02
- LMArena Text
- 1346 Elo2026-08-10
- LMArena Text
- 1346 Elo2026-08-06
- LMArena Text
- 1346 Elo2026-08-03
- LMArena Text
- 1346 Elo2026-08-21
- LMArena Text
- 1346 Elo2026-08-12
- LMArena Text
- 1346 Elo2026-09-01
- LMArena Text
- 1346 Elo2026-09-02
- LMArena Text
- 1346 Elo2026-08-27
- LMArena Vision
- 1137 Elo2026-07-12
- LMArena Vision
- 1162 Elo2026-07-21
- LMArena Vision
- 1162 Elo2026-07-26
- LMArena Vision
- 1162 Elo2026-07-30
- LMArena Vision
- 1162 Elo2026-08-02
- LMArena Vision
- 1162 Elo2026-08-06
- LMArena Vision
- 1162 Elo2026-08-21
- LMArena Vision
- 1162 Elo2026-08-27
- SWE-bench Verified
- 68.2%2025-05-16
- SWE-bench Verified
- 38.8%2024-10-28
LMArena data licensed CC-BY-4.0. Aider (Apache-2.0) and SWE-bench (MIT) are open. Design Arena uses blind human preference.
Task evidence
How broad is the support?
Each status is exact to this model version and the selected task. Official release claims remain provisional.
- Best LLM for Business WritingProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Marketing CopyProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Chat & RoleplayProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Roleplay & CharacterProvisional evidence
70% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Creative WritingProvisional evidence
60% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for WritingProvisional evidence
60% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Image UnderstandingProvisional evidence
55% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Reasoning or VLMEvalKit tasks. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for a General AssistantProvisional evidence
55% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Logic & Problem SolvingProvisional evidence
50% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Competition MathProvisional evidence
40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Mathematics or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Math & ReasoningProvisional evidence
40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Mathematics or LiveBench Reasoning. 5 of 5 configured evaluation feeds currently have results.
- Best Value LLMProvisional evidence
36% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Best Open-Weight LLM for Self-HostingProvisional evidence
33% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Fast SummariesProvisional evidence
29% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Literary TranslationProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 5 configured evaluation feeds currently have results.
- Best Cheap LLM for High VolumeProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for Everyday TranslationProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 5 configured evaluation feeds currently have results.
- Cheapest Capable LLMProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for TranslationProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Massive ContextProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or LongBench v2. 3 of 4 configured evaluation feeds currently have results.
- Best LLM for OCR & DocumentsProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Vision & DocumentsProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Charts & DiagramsProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Document ParsingProvisional evidence
25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or Structured-output eval. 3 of 5 configured evaluation feeds currently have results.
- Best LLM for Debugging & Code ReviewProvisional evidence
20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Aider Polyglot or LiveBench Coding. 6 of 6 configured evaluation feeds currently have results.
- Best LLM for Document SummarizationProvisional evidence
20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LiveBench Instruction Following. 4 of 6 configured evaluation feeds currently have results.
- Best LLM for SummarizationProvisional evidence
20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LiveBench Instruction Following. 4 of 6 configured evaluation feeds currently have results.
- Best LLM for RAG & Long ContextProvisional evidence
18% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LMArena Document. 4 of 6 configured evaluation feeds currently have results.
- Best LLM for JSON & Schema OutputProvisional evidence
17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Data Analysis. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Structured Data ExtractionProvisional evidence
17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Data Analysis. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for CodingProvisional evidence
16% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from Aider Polyglot or Design Arena Coding. 8 of 8 configured evaluation feeds currently have results.
- Best LLM for High-Volume ExtractionProvisional evidence
13% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from LiveBench Data Analysis or Route reliability. 2 of 4 configured evaluation feeds currently have results.
- Best LLM for Code CompletionProvisional evidence
13% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Aider Polyglot or LiveBench Coding. 4 of 4 configured evaluation feeds currently have results.
- Best LLM for Tool & Function CallingProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Agent. 4 of 5 configured evaluation feeds currently have results.
- Best LLM for Computer & Browser UseProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Agent. 4 of 4 configured evaluation feeds currently have results.
- Best LLM for Grounded RAGProvisional evidence
10% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from CRAG or FACTS Grounding. 2 of 5 configured evaluation feeds currently have results.
- Best LLM for Hermes AgentProvisional evidence
6% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Agent. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for OpenHandsProvisional evidence
6% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Agent. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for GooseProvisional evidence
6% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Agent. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for OpenClawProvisional evidence
6% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LMArena Agent. 5 of 5 configured evaluation feeds currently have results.
- Best Local LLM for CodingProvisional evidence
6% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Aider Polyglot or LiveBench Coding. 5 of 5 configured evaluation feeds currently have results.
- Best LLM for Agentic CodingProvisional evidence
5% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Design Arena Full-stack or Design Arena Web-apps. 8 of 8 configured evaluation feeds currently have results.
- Best LLM for Autonomous AgentsProvisional evidence
5% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Frontier-Bench or LiveBench Agentic Coding. 7 of 7 configured evaluation feeds currently have results.
- Best LLM for AI AgentsProvisional evidence
5% of intended weighted task evidence across 0 independent sources; broader independent confirmation is still missing from Berkeley Function Calling or LiveBench Agentic Coding. 7 of 7 configured evaluation feeds currently have results.
Recommendation coverage
Where this model appears
Not currently included in a published recommendation. The task evidence panel above says exactly what is confirmed and what is still missing.
Catalog data via OpenRouter and models.dev. Last checked within the past 6 hours.