Data points: 64
The readout for Claude 3 Haiku and Gemini 2.5 Pro, before the detailed comparison sheet.
Decision read
Gemini 2.5 Pro
Gemini 2.5 Pro currently has the stronger profile, with verified wins split 0 to 4.
Evidence depth
64 data points
Includes 0 benchmark rows, 0 audit samples, and 8 provider examples.
Selection signal
Start with Gemini 2.5 Pro
The charts below split 8 high-signal samples across speed, scores, and audit health.
Model compare Claude 3 Haiku vs Gemini 2.5 Proclaude-3-haiku-vs-gemini-2-5-pro | Model A Claude 3 Haiku | Model B Gemini 2.5 Pro |
|---|---|---|
| Overall leader | Contender | Leading |
| Verified metric wins | 0 wins | 4 wins |
| Where it leads | No data | Cheapest input price, Free providers, Provider coverage, Recent tests |
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
| Metric | Claude 3 Haiku | Gemini 2.5 Pro |
|---|---|---|
| No shared benchmark metrics are available yet. | ||
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Claude 3 Haiku | Gemini 2.5 Pro |
|---|---|---|
| No completed audits are available from shared providers yet. | ||
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Claude 3 Haiku | Gemini 2.5 Pro |
|---|---|---|
5 tests | Claude 3 Haiku claude-3-haiku-20240307 speed / latency N/A / N/A input / output $0.021/M / $0.107/M |
This report only uses LMSpeed data for Claude 3 Haiku and Gemini 2.5 Pro: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Guidance | Claude 3 Haiku | Gemini 2.5 Pro |
|---|---|---|
| When to choose each model | Claude 3 Haiku Claude 3 Haiku does not clearly lead on the verified metrics here, so check provider-specific pricing before choosing. | Gemini 2.5 Pro Gemini 2.5 Pro is stronger when you prioritize Cheapest input price, Free providers, Provider coverage, Recent tests. |
TL;DR: Gemini 2.5 Pro leads across 64 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.
Continue from Claude 3 Haiku vs Gemini 2.5 Pro into nearby model comparisons with enough verified LMSpeed data.
| Model metadata | Claude 3 Haiku exposes 200K tokens; notable signals: Text input, Image input, Text output, Tool calling. | Gemini 2.5 Pro exposes 1.0M tokens; notable signals: Text input, Image input, File input, Audio input. |
|---|---|---|
| Developer | Anthropic | |
| Context window | 200K tokens | 1.0M tokens |
| Max output | 4.1K tokens | 65.5K tokens |
| Released | Mar 2024 | Jun 2025 |
| Modalities | Input TextImage Output Text | Input TextImageFileAudiovideo Output Text |
| Features | Text inputImage inputText outputTool calling | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning |
| Parameters | No data | No data |
| Tokenizer | Claude | Gemini |
| Knowledge cutoff | 2023-08-31 | 2025-01-31 |
| OpenRouter ID | anthropic/claude-3-haiku | google/gemini-2.5-pro |
| References | No data | No data |
Gemini 2.5 Pro
gemini-2.5-pro
speed / latency
81 tok/s / 21179ms
input / output
$0.107/M / $0.857/M
AASS API0 tests | Claude 3 Haiku speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
|---|
AIGCBAR0 tests | Claude 3 Haiku speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
|---|
AIO通用智能服务平台0 tests | Claude 3 Haiku speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
|---|
DuckDuck API0 tests | Claude 3 Haiku speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
|---|
Claude 3 Haiku claude-3-haiku-20240307 speed / latency No data input / output $0.034/M / $0.171/M | Gemini 2.5 Pro gemini-2.5-pro-as speed / latency No data input / output $10.27/M / $82.19/M |
Claude 3 Haiku claude-3-haiku-20240307 speed / latency No data input / output $0.034/M / $0.171/M | Gemini 2.5 Pro gemini-2.5-pro-nothinking speed / latency No data input / output $0.171/M / $1.37/M |
Claude 3 Haiku claude-3-haiku-20241022 speed / latency No data input / output $0.034/M / $0.171/M | Gemini 2.5 Pro gemini-2.5-pro-preview-05-06 speed / latency No data input / output $0.411/M / $2.05/M |
Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.
