Data points: 134
The readout for Gemini 2.5 Pro and GPT-5.4 Mini, before the detailed comparison sheet.
Decision read
GPT-5.4 Mini
GPT-5.4 Mini currently has the stronger profile, with verified wins split 0 to 6.
Evidence depth
134 data points
Includes 34 benchmark rows, 0 audit samples, and 10 provider examples.
Selection signal
Start with GPT-5.4 Mini
The charts below split 44 high-signal samples across speed, scores, and audit health.
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
Model compare Gemini 2.5 Pro vs GPT-5.4 Minigemini-2-5-pro-vs-gpt-5-4-mini | Model A Gemini 2.5 Pro | Model B GPT-5.4 Mini |
|---|---|---|
| Overall leader | Contender | Leading |
| Verified metric wins | 0 wins | 6 wins |
| Where it leads | No data | Cheapest input price, Average speed, First-token latency, Free providers, Provider coverage, Recent tests |
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.
Avg. score
Gemini 2.5 Pro
60.8
Avg. score
GPT-5.4 Mini
59.6
Selected category
Instruction following
GPT-5.4 Mini leads by 24.6
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
Gemini 2.5 Pro
63.0
Rank #30/81 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner68.0
Rank #25/81 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
132.3 tok/s
Rank #25/83 · confidence 4
GPT-5.4 Mini
winner179.7 tok/s
Rank #12/83 · confidence 4
Gemini 2.5 Pro
18.90 s
Rank #49/83 · confidence 4
GPT-5.4 Mini
winner9.94 s
Rank #43/83 · confidence 4
Gemini 2.5 Pro
18.90 s
Rank #69/83 · confidence 4
GPT-5.4 Mini
winner9.94 s
Rank #66/83 · confidence 4
Gemini 2.5 Pro
$1.25/M
Rank #62/96 · confidence 4
GPT-5.4 Mini
winner$0.750/M
Rank #53/96 · confidence 4
Gemini 2.5 Pro
$3.44/M
Rank #66/96 · confidence 4
GPT-5.4 Mini
winner$1.69/M
Rank #55/96 · confidence 4
Gemini 2.5 Pro
$10.00/M
Rank #68/96 · confidence 4
GPT-5.4 Mini
winner$4.50/M
Rank #61/96 · confidence 4
Gemini 2.5 Pro
2.6
Rank #24/43 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner10.0
Rank #8/43 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
66.0
Rank #20/56 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner69.3
Rank #12/56 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
winner59.0
Rank #27/57 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
15.2
Rank #55/57 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
winner84.4%
Rank #32/104 · confidence 4
GPT-5.4 Mini
82.3%
Rank #41/104 · confidence 4
Gemini 2.5 Pro
winner21.1%
Rank #36/104 · confidence 4
GPT-5.4 Mini
17.1%
Rank #43/104 · confidence 4
Gemini 2.5 Pro
26.5
Rank #38/58 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner52.3
Rank #6/58 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
31.9
Rank #36/60 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner51.5
Rank #7/60 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
0.4
Rank #26/26 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner48.0
Rank #7/26 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
42.8
Rank #27/62 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner49.9
Rank #11/62 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
48.5
Rank #45/68 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner75.7
Rank #25/68 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
42.8%
Rank #32/102 · confidence 4
GPT-5.4 Mini
winner44.2%
Rank #26/102 · confidence 4
Gemini 2.5 Pro
73.5
Rank #21/51 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner92.2
Rank #8/51 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
87.4
Rank #14/57 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner89.8
Rank #8/57 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
84.4
Rank #27/62 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner87.5
Rank #13/62 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
34.6
Rank #37/65 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner48.9
Rank #16/65 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
winner39.0
Rank #17/57 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
37.5
Rank #21/57 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
64.9
Rank #30/66 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner80.0
Rank #17/66 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
21.1
Rank #27/62 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner26.6
Rank #18/62 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
winner85.2
Rank #9/60 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
71.2
Rank #21/60 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
winner74.9
Rank #13/34 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
73.3
Rank #15/34 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
48.7
Rank #35/59 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner73.3
Rank #13/59 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
59.0
Rank #40/56 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner72.2
Rank #29/56 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
20.9
Rank #41/51 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner46.9
Rank #14/51 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
918.0
Rank #41/56 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner1438.0
Rank #14/56 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
57.5
Rank #27/68 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner72.6
Rank #20/68 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
32.7
Rank #41/56 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner58.9
Rank #22/56 · confidence 2 · eval date 2026-03-17
Gemini 2.5 Pro
54.1
Rank #41/57 · confidence 1 · eval date 2025-03-01
GPT-5.4 Mini
winner83.3
Rank #27/57 · confidence 2 · eval date 2026-03-17
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Gemini 2.5 Pro | GPT-5.4 Mini |
|---|---|---|
| No completed audits are available from shared providers yet. | ||
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Gemini 2.5 Pro | GPT-5.4 Mini |
|---|---|---|
10 tests | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data |
This report only uses LMSpeed data for Gemini 2.5 Pro and GPT-5.4 Mini: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Guidance | Gemini 2.5 Pro | GPT-5.4 Mini |
|---|---|---|
| When to choose each model | Gemini 2.5 Pro Gemini 2.5 Pro does not clearly lead on the verified metrics here, so check provider-specific pricing before choosing. | GPT-5.4 Mini GPT-5.4 Mini is stronger when you prioritize Cheapest input price, Average speed, First-token latency, Free providers, Provider coverage, Recent tests. |
TL;DR: GPT-5.4 Mini leads across 134 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.
Continue from Gemini 2.5 Pro vs GPT-5.4 Mini into nearby model comparisons with enough verified LMSpeed data.
| Model metadata | Gemini 2.5 Pro exposes 1.0M tokens; notable signals: Text input, Image input, File input, Audio input. | GPT-5.4 Mini exposes 400K tokens; notable signals: Text input, Image input, File input, Text output. |
|---|---|---|
| Developer | OpenAI | |
| Context window | 1.0M tokens | 400K tokens |
| Max output | 65.5K tokens | 128K tokens |
| Released | Jun 2025 | Mar 2026 |
| Modalities | Input TextImageFileAudiovideo Output Text | Input FileImageText Output Text |
| Features | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning | Text inputImage inputFile inputText outputTool callingStructured outputs |
| Parameters | No data | No data |
| Tokenizer | Gemini | GPT |
| Knowledge cutoff | 2025-01-31 | 2025-08-31 |
| OpenRouter ID | google/gemini-2.5-pro | openai/gpt-5.4-mini |
| References | No data | No data |
GPT-5.4 Mini
speed / latency
181 tok/s / 3275ms
input / output
No data
DeepRouter5 tests | Gemini 2.5 Pro speed / latency 92 tok/s / 16347ms input / output No data | GPT-5.4 Mini speed / latency N/A / N/A input / output No data |
|---|
N1N5 tests | Gemini 2.5 Pro speed / latency 106 tok/s / 16405ms input / output No data | GPT-5.4 Mini speed / latency N/A / N/A input / output No data |
|---|
Rnglg2 API5 tests | Gemini 2.5 Pro speed / latency 111 tok/s / 17899ms input / output No data | GPT-5.4 Mini speed / latency N/A / N/A input / output No data |
|---|
Vercel AI Gateway5 tests | Gemini 2.5 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 Mini speed / latency 195 tok/s / 1104ms input / output No data |
|---|
Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.010/M / $0.010/M | GPT-5.4 Mini gpt-5.4-mini speed / latency No data input / output $0.750/M / $4.50/M |
Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.014/M / $0.904/M | GPT-5.4 Mini gpt-5.4-mini speed / latency No data input / output $0.103/M / $0.619/M |
Gemini 2.5 Pro gemini-2.5-pro-preview speed / latency No data input / output $10.27/M / $82.19/M | GPT-5.4 Mini gpt-5.4-mini speed / latency No data input / output $0.014/M / $0.082/M |
Gemini 2.5 Pro gemini-2.5-pro speed / latency No data input / output $0.014/M / $0.014/M | GPT-5.4 Mini gpt-5.4-mini-openai-compact speed / latency No data input / output $10.27/M / $10.27/M |
Gemini 2.5 Pro gemini-2.5-pro-search speed / latency No data input / output $0.021/M / $0.164/M | GPT-5.4 Mini openai/gpt-5.4-mini speed / latency No data input / output $15.41/M / $15.41/M |
Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.
