Phi 4

microsoft/phi-4

Phi 4 is a text-only model from Microsoft released on 2024-12-11. It supports a context window of up to 16,384 tokens, has open weights, and does not support tools or reasoning. Pricing is $0.07 per million input tokens and $0.14 per million output tokens.

  • structured outputs
  • open-weight

At a glance

providermicrosoft
releasedDec 11, 2024
context16K
input / M$0.070

Specifications

What the API gives you

Context window
16K tokens
Max output
15K tokens
Input price
$0.070 / 1M tokens
Output price
$0.14 / 1M tokens
Cache read
—
Modalities
text → text
Knowledge cutoff
Jun 30, 2024
Released
Dec 11, 2024

Measured evidence

Public benchmark record

BFCL
28.8%2026-10-20
GPQA Diamond (Epoch AI)
56.1% ± 2.62025-01-31evaluated 2025-01-31
LMArena Creative Writing
1181 Elo2026-10-15
LMArena Long Query
1217 Elo2026-10-15
LMArena Math
1246 Elo2026-10-15
LMArena Text
1256 Elo2026-10-15
OTIS Mock AIME (Epoch AI)
13.8% ± 3.72025-02-25evaluated 2025-02-25

LMArena data licensed CC-BY-4.0. Aider (Apache-2.0) and SWE-bench (MIT) are open. Design Arena uses blind human preference.

Open-weight model on Hugging Face.

Task evidence

How broad is the support?

Each status is exact to this model version and the selected task. Official release claims remain provisional.

  • 55% of intended weighted task evidence across 2 independent sources. 5 of 5 configured evaluation feeds currently have results.

  • Best LLM for Math & ReasoningEstablished evidence

    44% of intended weighted task evidence across 3 independent sources. 7 of 7 configured evaluation feeds currently have results.

  • Best LLM for Competition MathEstablished evidence

    37% of intended weighted task evidence across 2 independent sources. 6 of 6 configured evaluation feeds currently have results.

  • 29% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.

  • 29% of intended weighted task evidence across 2 independent sources. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for Business WritingProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 4 of 4 configured evaluation feeds currently have results.

Show all 31 tasks
  • Best LLM for Marketing CopyProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Chat & RoleplayProvisional evidence

    67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • 67% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for Creative WritingProvisional evidence

    56% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for WritingProvisional evidence

    56% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 4 of 4 configured evaluation feeds currently have results.

  • 41% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from SimpleQA Verified (Epoch AI) or LiveBench Instruction Following. 6 of 6 configured evaluation feeds currently have results.

  • Best LLM for Hermes AgentProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for OpenHandsProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for GooseProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • Best LLM for OpenClawProvisional evidence

    40% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or SWE-rebench. 4 of 4 configured evaluation feeds currently have results.

  • 27% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • 25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or LMArena Agent Steerability. 6 of 7 configured evaluation feeds currently have results.

  • Best Value LLMProvisional evidence

    25% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for Massive ContextProvisional evidence

    20% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Document or LongBench v2. 2 of 3 configured evaluation feeds currently have results.

  • Best LLM for AI AgentsProvisional evidence

    18% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Agentic Coding or LMArena Agent. 9 of 9 configured evaluation feeds currently have results.

  • Best LLM for Fast SummariesProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • 17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • 17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • Best LLM for TranslationProvisional evidence

    17% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or LiveBench Language. 3 of 4 configured evaluation feeds currently have results.

  • 11% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LMArena Document. 5 of 6 configured evaluation feeds currently have results.

  • 11% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LMArena Agent or OSWorld Verified. 3 of 3 configured evaluation feeds currently have results.

  • 10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LiveBench Instruction Following. 5 of 6 configured evaluation feeds currently have results.

  • Best LLM for SummarizationProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from FACTS Grounding or LiveBench Instruction Following. 5 of 6 configured evaluation feeds currently have results.

  • Best Cheap LLM for High VolumeProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

  • Cheapest Capable LLMProvisional evidence

    10% of intended weighted task evidence across 1 independent source; broader independent confirmation is still missing from LiveBench Instruction Following or Route reliability. 2 of 3 configured evaluation feeds currently have results.

Recommendation coverage

Where this model appears

Not currently included in a published recommendation. The task evidence panel above says exactly what is confirmed and what is still missing.

Catalog data via OpenRouter and models.dev. Last checked within the past 6 hours.