Data points: 82
The readout for Claude Sonnet 4 and Gemini 2.5 Pro, before the detailed comparison sheet.
Decision read
Gemini 2.5 Pro
Gemini 2.5 Pro currently has the stronger profile, with verified wins split 1 to 5.
Evidence depth
82 data points
Includes 8 benchmark rows, 0 audit samples, and 8 provider examples.
Selection signal
Start with Gemini 2.5 Pro
The charts below split 16 high-signal samples across speed, scores, and audit health.
Model compare Claude Sonnet 4 vs Gemini 2.5 Proclaude-sonnet-4-vs-gemini-2-5-pro | Model A Claude Sonnet 4 | Model B Gemini 2.5 Pro |
|---|---|---|
| Overall leader | Contender | Leading |
| Verified metric wins | 1 wins | 5 wins |
| Where it leads | First-token latency | Cheapest input price, Average speed, Free providers, Provider coverage, Recent tests |
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
| Metric | Claude Sonnet 4 | Gemini 2.5 Pro |
|---|---|---|
| AIME | 40.7%#29 |
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Claude Sonnet 4 | Gemini 2.5 Pro |
|---|---|---|
| No completed audits are available from shared providers yet. | ||
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Claude Sonnet 4 | Gemini 2.5 Pro |
|---|---|---|
15 tests | Claude Sonnet 4 speed / latency 36 tok/s / 6227ms input / output No data |
This report only uses LMSpeed data for Claude Sonnet 4 and Gemini 2.5 Pro: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Guidance | Claude Sonnet 4 | Gemini 2.5 Pro |
|---|---|---|
| When to choose each model | Claude Sonnet 4 Claude Sonnet 4 is stronger when you prioritize First-token latency. | Gemini 2.5 Pro Gemini 2.5 Pro is stronger when you prioritize Cheapest input price, Average speed, Free providers, Provider coverage, Recent tests. |
TL;DR: Gemini 2.5 Pro leads across 82 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.
Continue from Claude Sonnet 4 vs Gemini 2.5 Pro into nearby model comparisons with enough verified LMSpeed data.
| Model metadata | Claude Sonnet 4 exposes 1M tokens; notable signals: Text input, Image input, File input, Text output. | Gemini 2.5 Pro exposes 1.0M tokens; notable signals: Text input, Image input, File input, Audio input. |
|---|---|---|
| Developer | Anthropic | |
| Context window | 1M tokens | 1.0M tokens |
| Max output | 64K tokens | 65.5K tokens |
| Released | May 2025 | Jun 2025 |
| Modalities | Input ImageTextFile Output Text | Input TextImageFileAudiovideo Output Text |
| Features | Text inputImage inputFile inputText outputTool callingReasoning | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning |
| Parameters | No data | No data |
| Tokenizer | Claude | Gemini |
| Knowledge cutoff | 2025-01-31 | 2025-01-31 |
| OpenRouter ID | anthropic/claude-sonnet-4 | google/gemini-2.5-pro |
| References | No data | No data |
| MMLU-Pro | 83.7%#23 | 86.2%#12 |
|---|
| MATH-500 | 93.4%#23 | 96.7%#16 |
|---|
| LiveCodeBench | 44.9%#61 | 80.1%#18 |
|---|
| Time to first answer token | 1.07 s#24 | 23.08 s#77 |
|---|
| Input price | $3.00/M#39 | $1.25/M#30 |
|---|
| SciCode | 37.3%#64 | 42.8%#32 |
|---|
| GPQA | 68.3%#83 | 84.4%#36 |
|---|
Gemini 2.5 Pro
speed / latency
N/A / N/A
input / output
No data
Completions5 tests | Claude Sonnet 4 speed / latency 27 tok/s / 1036ms input / output No data | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
|---|
DeepRouter5 tests | Claude Sonnet 4 speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency 92 tok/s / 16347ms input / output No data |
|---|
ModelPool5 tests | Claude Sonnet 4 claude-sonnet-4-20250514 speed / latency N/A / N/A input / output $0.257/M / $1.29/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency 81 tok/s / 21179ms input / output $0.107/M / $0.857/M |
|---|
N1N5 tests | Claude Sonnet 4 speed / latency N/A / N/A input / output No data | Gemini 2.5 Pro speed / latency 106 tok/s / 16405ms input / output No data |
|---|
Claude Sonnet 4 claude-sonnet-4 speed / latency No data input / output $0.0010/M / $0.0010/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $1.25/M / $10.00/M |
Claude Sonnet 4 claude-4-sonnet speed / latency No data input / output $1.03/M / $1.03/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.034/M / $0.274/M |
Claude Sonnet 4 claude-sonnet-4-20250514 speed / latency No data input / output $0.205/M / $1.03/M | Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.086/M / $0.685/M |
Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.
