LogoLMSpeed
  • Home
  • Free
  • Models
  • Providers
  • Docs
LogoLMSpeed
LogoLMSpeed

The best API speed test tool

GitHubGitHubTwitterX (Twitter)Email
Product
  • Features
  • Pricing
  • FAQ
Leaderboard
  • Overview
  • Speed Ranking
  • Latency Ranking
  • Health Ranking
  • Model Pricing
  • Model Speed
  • Reasoning
  • Coding
Models
  • All Models
  • GPT
  • Claude
  • Gemini
  • DeepSeek
  • Llama
  • Qwen
Free Models
  • All Free Models
  • Free GPT
  • Free Claude
  • Free Gemini
  • Free DeepSeek
  • Free Llama
  • Free Qwen
Resources
  • Speed Test
  • Provider Directory
  • Documentation
Legal
  • Cookie Policy
  • Privacy Policy
  • Terms of Service
© 2026 LMSpeed All Rights Reserved.Made by Nexmoe with ❤️
Back to models

Data points: 82

On this page

Key TakeawaysComparison sheetBenchmark score comparisonAPI audit comparisonProvider examplesWhen to choose each modelFAQRelated compare reports

Key Takeaways

The readout for Gemini 2.5 Pro and GPT-4o Mini, before the detailed comparison sheet.

Decision read

Tie

Tie currently has the stronger profile, with verified wins split 3 to 3.

Evidence depth

82 data points

Includes 8 benchmark rows, 0 audit samples, and 10 provider examples.

Selection signal

Tie

The charts below split 18 high-signal samples across speed, scores, and audit health.

Model compare

Gemini 2.5 Pro vs GPT-4o Mini

gemini-2-5-pro-vs-gpt-4o-mini

Model A

Gemini

Gemini 2.5 Pro

Model B

OpenAI

GPT-4o Mini

Overall leaderTieTie
Verified metric wins3 wins3 wins
Where it leadsAverage speed, Free providers, Provider coverageCheapest input price, First-token latency, Recent tests
Model metadataGemini 2.5 Pro exposes 1.0M tokens; notable signals: Text input, Image input, File input, Audio input.GPT-4o Mini exposes 128K tokens; notable signals: Text input, Image input, File input, Text output.
DeveloperGoogleOpenAI
Context window1.0M tokens128K tokens
Max output65.5K tokens16.4K tokens
ReleasedJun 2025Jul 2024
Modalities

Input

TextImageFileAudiovideo

Output

Text

Input

TextImageFile

Output

Text
Features
Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning
Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeWeb search
ParametersNo dataNo data
TokenizerGeminiGPT
Knowledge cutoff2025-01-312023-10-31
OpenRouter IDgoogle/gemini-2.5-proopenai/gpt-4o-mini-2024-07-18
ReferencesNo dataNo data

Benchmark score comparison

Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.

Metric
GeminiGemini 2.5 Pro
OpenAIGPT-4o Mini
AIME
88.7%#6
11.7%#44
Input price
$1.25/M#30
$0.150/M#9
Time to first answer token
23.08 s#77
0.53 s#9
Output price
$10.00/M#41
$0.600/M#10
MMLU-Pro
86.2%#12
64.8%#72
Time to first token
23.08 s#97
0.53 s#13
Blended price
$3.44/M#58
$0.262/M#15
MATH-500
96.7%#16
78.9%#44

API audit comparison

Latest completed audits from shared providers, with four safety and integrity score groups plus report links.

Provider
GeminiGemini 2.5 Pro
OpenAIGPT-4o Mini
No completed audits are available from shared providers yet.

Provider examples

Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.

Provider
GeminiGemini 2.5 Pro
OpenAIGPT-4o Mini
X666 API158 tests
Gemini

Gemini 2.5 Pro

speed / latency

N/A / N/A

input / output

No data

OpenAI

GPT-4o Mini

speed / latency

81 tok/s / 2589ms

input / output

No data

Academic Sanctum10 tests
Gemini

Gemini 2.5 Pro

speed / latency

79 tok/s / 19137ms

input / output

No data

OpenAI

GPT-4o Mini

speed / latency

95 tok/s / 4747ms

input / output

No data

Gpt API10 tests
Gemini

Gemini 2.5 Pro

speed / latency

N/A / N/A

input / output

No data

OpenAI

GPT-4o Mini

speed / latency

84 tok/s / 5980ms

input / output

No data

DeepRouter5 tests
Gemini

Gemini 2.5 Pro

speed / latency

92 tok/s / 16347ms

input / output

No data

OpenAI

GPT-4o Mini

speed / latency

N/A / N/A

input / output

No data

ModelPool5 tests
Gemini

Gemini 2.5 Pro

speed / latency

81 tok/s / 21179ms

input / output

No data

OpenAI

GPT-4o Mini

speed / latency

N/A / N/A

input / output

No data

Koyeb AI Gateway
Gemini

Gemini 2.5 Pro

gemini-2.5-pro

speed / latency

No data

input / output

$0.0006/M / $0.0050/M

OpenAI

GPT-4o Mini

gpt-4o-mini

speed / latency

No data

input / output

$0.0001/M / $0.0003/M

SWT-API
Gemini

Gemini 2.5 Pro

gemini-2.5-pro

speed / latency

No data

input / output

$0.0006/M / $0.0050/M

OpenAI

GPT-4o Mini

gpt-4o-mini

speed / latency

No data

input / output

$0.0001/M / $0.0003/M

ZEN-AI VIP
Gemini

Gemini 2.5 Pro

gemini-2.5-pro

speed / latency

No data

input / output

$0.051/M / $0.411/M

OpenAI

GPT-4o Mini

gpt-4o-mini-2024-07-18

speed / latency

No data

input / output

$0.0062/M / $0.025/M

ChatGTP
Gemini

Gemini 2.5 Pro

gemini-2.5-pro-c

speed / latency

No data

input / output

$0.0082/M / $0.0082/M

OpenAI

GPT-4o Mini

gpt-4o-mini

speed / latency

No data

input / output

$0.021/M / $0.082/M

Zero API
Gemini

Gemini 2.5 Pro

gemini-2.5-pro

speed / latency

No data

input / output

$0.086/M / $0.685/M

OpenAI

GPT-4o Mini

gpt-4o-mini

speed / latency

No data

input / output

$0.010/M / $0.041/M

When to choose each model

This report only uses LMSpeed data for Gemini 2.5 Pro and GPT-4o Mini: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.

Guidance
GeminiGemini 2.5 Pro
OpenAIGPT-4o Mini
When to choose each model

Gemini 2.5 Pro

Gemini 2.5 Pro is stronger when you prioritize Average speed, Free providers, Provider coverage.

GPT-4o Mini

GPT-4o Mini is stronger when you prioritize Cheapest input price, First-token latency, Recent tests.

FAQ

TL;DR: Tie leads across 82 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.

Why is this comparison indexable?
It has 6 verifiable comparison points, and both models have pricing or benchmark data.
Are missing metrics invented?
No. Metrics without LMSpeed data are omitted from this report.

Related compare reports

Continue from Gemini 2.5 Pro vs GPT-4o Mini into nearby model comparisons with enough verified LMSpeed data.

GeminiGemini 2.5 Pro vs GPT-5.46 verified data pointsClaudeClaude Opus 4.6 vs Gemini 2.5 Pro6 verified data pointsGeminiGemini 2.5 Pro vs GPT-56 verified data pointsGeminiGemini 2.5 Pro vs GPT-5.26 verified data points

Data as of Jun 13, 2026, 03:03 PM·Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.