token.app › Compare › Claude 3 Haiku vs Phi 4
Claude 3 Haiku vs Phi 4
Phi 4 leads on 2 of 2 shared benchmarks. Phi 4 is 5.7× cheaper per token on a blended 3:1 basis. Claude 3 Haiku accepts the larger context window (200K).
Head to head
Blended price uses a 3:1 input:output mix
| Claude 3 Haiku | Phi 4 | |
|---|---|---|
| Provider | Anthropic | Microsoft |
| Input $/1M | $0.250 | $0.070 |
| Output $/1M | $1.25 | $0.140 |
| Blended $/1M | $0.500 | $0.088 |
| Context window | 200K | 16K |
| Max output | 4K | 16K |
| Released | Mar 2024 | Jan 2025 |
| Licence | Proprietary | Open weights |
| GPQA Diamond | 36.3% | 56.1% |
| OTIS Mock AIME | 1.8% | 13.8% |
Benchmark scores independently run and published by Epoch AI, 'AI Benchmarking Hub', used under CC BY 4.0. Only benchmarks with a score for BOTH models are compared.
Choose Claude 3 Haiku if…
- Larger context window (200K)
Choose Phi 4 if…
- Costs less per token — $0.088 vs $0.500 blended
- Higher GPQA Diamond (56.1% vs 36.3%)
- Higher OTIS Mock AIME (13.8% vs 1.8%)
- Open weights — self-hostable
- Newer model (released Jan 2025)
FAQ
Which is better, Claude 3 Haiku or Phi 4?
Across the 2 benchmarks both models have independently-run scores for, Claude 3 Haiku leads on 0 and Phi 4 leads on 2. Benchmarks are one input — price and context window are on this page too.
Is Claude 3 Haiku cheaper than Phi 4?
Phi 4 is cheaper: $0.088 versus $0.500 per million tokens blended at 3:1 input:output. Input alone: $0.250 vs $0.070. Output alone: $1.25 vs $0.140.
What context windows do Claude 3 Haiku and Phi 4 have?
Claude 3 Haiku: 200,000 tokens. Phi 4: 16,384 tokens.
Who makes Claude 3 Haiku and Phi 4?
Claude 3 Haiku is made by Anthropic. Phi 4 is made by Microsoft.