token.app โ€บ Compare โ€บ Claude Haiku 4.5 vs Gemma 4 31B

Claude Haiku 4.5 vs Gemma 4 31B

Gemma 4 31B leads on 3 of 3 shared benchmarks. Gemma 4 31B is 12ร— cheaper per token on a blended 3:1 basis. Gemma 4 31B accepts the larger context window (262K).

Head to head
Blended price uses a 3:1 input:output mix
Claude Haiku 4.5Gemma 4 31B
ProviderAnthropicGoogle
Input $/1M$1.00$0.100
Output $/1M$5.00$0.340
Blended $/1M$2.00$0.160
Context window200K262K
Max output64K262K
ReleasedOct 2025Apr 2026
LicenceProprietaryOpen weights
GPQA Diamond 71.2% 75.8%
SimpleQA Verified 5.9% 9.6%
OTIS Mock AIME 66.7% 73.3%
Benchmark scores independently run and published by Epoch AI, 'AI Benchmarking Hub', used under CC BY 4.0. Only benchmarks with a score for BOTH models are compared.
Choose Claude Haiku 4.5 ifโ€ฆ
  • No clear advantage on the data we hold.
Choose Gemma 4 31B ifโ€ฆ
  • Costs less per token โ€” $0.160 vs $2.00 blended
  • Higher GPQA Diamond (75.8% vs 71.2%)
  • Higher SimpleQA Verified (9.6% vs 5.9%)
  • Higher OTIS Mock AIME (73.3% vs 66.7%)
  • Larger context window (262K)
  • Open weights โ€” self-hostable
  • Newer model (released Apr 2026)
FAQ
Which is better, Claude Haiku 4.5 or Gemma 4 31B?
Across the 3 benchmarks both models have independently-run scores for, Claude Haiku 4.5 leads on 0 and Gemma 4 31B leads on 3. Benchmarks are one input โ€” price and context window are on this page too.
Is Claude Haiku 4.5 cheaper than Gemma 4 31B?
Gemma 4 31B is cheaper: $0.160 versus $2.00 per million tokens blended at 3:1 input:output. Input alone: $1.00 vs $0.100. Output alone: $5.00 vs $0.340.
What context windows do Claude Haiku 4.5 and Gemma 4 31B have?
Claude Haiku 4.5: 200,000 tokens. Gemma 4 31B: 262,144 tokens.
Who makes Claude Haiku 4.5 and Gemma 4 31B?
Claude Haiku 4.5 is made by Anthropic. Gemma 4 31B is made by Google.
Related comparisons