Data points: 81
The readout for Claude Haiku 4.5 and Gemini 2.5 Pro, before the detailed comparison sheet.
Decision read
Claude Haiku 4.5
Claude Haiku 4.5 currently has the stronger profile, with verified wins split 5 to 1.
Evidence depth
81 data points
Includes 8 benchmark rows, 0 audit samples, and 9 provider examples.
Selection signal
Start with Claude Haiku 4.5
The charts below split 17 high-signal samples across speed, scores, and audit health.
Model compare Claude Haiku 4.5 vs Gemini 2.5 Proclaude-haiku-4-5-vs-gemini-2-5-pro | Model A Claude Haiku 4.5 | Model B Gemini 2.5 Pro |
|---|---|---|
| Overall leader | Leading | Contender |
| Verified metric wins | 5 wins | 1 wins |
| Where it leads | Cheapest input price, Average speed, First-token latency, Free providers, Provider coverage |
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
| Metric | Claude Haiku 4.5 | Gemini 2.5 Pro |
|---|---|---|
| MMLU-Pro | 80.0%#40 |
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Claude Haiku 4.5 | Gemini 2.5 Pro |
|---|---|---|
| No completed audits are available from shared providers yet. | ||
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Claude Haiku 4.5 | Gemini 2.5 Pro |
|---|---|---|
20 tests | Claude Haiku 4.5 speed / latency 112 tok/s / 1733ms input / output No data |
This report only uses LMSpeed data for Claude Haiku 4.5 and Gemini 2.5 Pro: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Guidance | Claude Haiku 4.5 | Gemini 2.5 Pro |
|---|---|---|
| When to choose each model | Claude Haiku 4.5 Claude Haiku 4.5 is stronger when you prioritize Cheapest input price, Average speed, First-token latency, Free providers, Provider coverage. | Gemini 2.5 Pro Gemini 2.5 Pro is stronger when you prioritize Recent tests. |
TL;DR: Claude Haiku 4.5 leads across 81 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.
Continue from Claude Haiku 4.5 vs Gemini 2.5 Pro into nearby model comparisons with enough verified LMSpeed data.
| Recent tests |
| Model metadata | Claude Haiku 4.5 exposes 200K tokens; notable signals: Text input, Image input, File input, Text output. | Gemini 2.5 Pro exposes 1.0M tokens; notable signals: Text input, Image input, File input, Audio input. |
|---|---|---|
| Developer | Anthropic | |
| Context window | 200K tokens | 1.0M tokens |
| Max output | 64K tokens | 65.5K tokens |
| Released | Oct 2025 | Jun 2025 |
| Modalities | Input TextImageFile Output Text | Input TextImageFileAudiovideo Output Text |
| Features | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputs |
| Parameters | No data | No data |
| Tokenizer | Claude | Gemini |
| Knowledge cutoff | No data | 2025-01-31 |
| OpenRouter ID | anthropic/claude-haiku-4.5 | google/gemini-2.5-pro |
| References | No data | No data |
| LiveCodeBench | 51.1%#55 | 80.1%#18 |
|---|
| Time to first answer token | 0.90 s#22 | 23.08 s#77 |
|---|
| Input price | $1.00/M#26 | $1.25/M#30 |
|---|
| SciCode | 34.4%#78 | 42.8%#32 |
|---|
| Time to first token | 0.90 s#32 | 23.08 s#97 |
|---|
| GPQA | 64.6%#96 | 84.4%#36 |
|---|
| Output speed | 103.5 tok/s#48 | 132.3 tok/s#36 |
|---|
Gemini 2.5 Pro
speed / latency
106 tok/s / 16405ms
input / output
No data
Rnglg2 API10 tests | Claude Haiku 4.5 speed / latency 160 tok/s / 2639ms input / output No data | Gemini 2.5 Pro speed / latency 111 tok/s / 17899ms input / output No data |
|---|
Completions5 tests | Claude Haiku 4.5 speed / latency 21 tok/s / 1170ms input / output No data | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
|---|
DeepRouter5 tests | Claude Haiku 4.5 speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency 92 tok/s / 16347ms input / output No data |
|---|
ModelPool5 tests | Claude Haiku 4.5 speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency 81 tok/s / 21179ms input / output No data |
|---|
Claude Haiku 4.5 claude-haiku-4.5 speed / latency No data input / output $0/M / $0/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $1.13/M / $9.00/M |
Claude Haiku 4.5 claude-haiku-4-5-20251001 speed / latency No data input / output $0/M / $0/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0/M / $0/M |
Claude Haiku 4.5 claude-haiku-4-5-20251001 speed / latency No data input / output $0.137/M / $0.685/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.014/M / $0.904/M |
Claude Haiku 4.5 claude-haiku-4-5-20251001 speed / latency No data input / output $0.014/M / $0.068/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.034/M / $0.274/M |
Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.
