LogoLMSpeed
  • Home
  • Free
  • Models
  • Providers
  • Docs
LogoLMSpeed
LogoLMSpeed

The best API speed test tool

GitHubGitHubTwitterX (Twitter)Email
Product
  • Features
  • Pricing
  • FAQ
Leaderboard
  • Overview
  • Speed Ranking
  • Latency Ranking
  • Health Ranking
  • Model Pricing
  • Model Speed
  • Reasoning
  • Coding
Models
  • All Models
  • GPT
  • Claude
  • Gemini
  • DeepSeek
  • Llama
  • Qwen
Free Models
  • All Free Models
  • Free GPT
  • Free Claude
  • Free Gemini
  • Free DeepSeek
  • Free Llama
  • Free Qwen
Resources
  • Speed Test
  • Provider Directory
  • Documentation
Legal
  • Cookie Policy
  • Privacy Policy
  • Terms of Service
© 2026 LMSpeed All Rights Reserved.Made by Nexmoe with ❤️
Back to models

Data points: 60

On this page

Key TakeawaysComparison sheetBenchmark score comparisonAPI audit comparisonProvider examplesWhen to choose each modelFAQRelated compare reports

Key Takeaways

The readout for Gemini 1.5 Pro and GPT-5.4, before the detailed comparison sheet.

Decision read

GPT-5.4

GPT-5.4 currently has the stronger profile, with verified wins split 0 to 4.

Evidence depth

60 data points

Includes 3 benchmark rows, 0 audit samples, and 8 provider examples.

Selection signal

Start with GPT-5.4

The charts below split 11 high-signal samples across speed, scores, and audit health.

Model compare

Gemini 1.5 Pro vs GPT-5.4

gemini-1-5-pro-vs-gpt-5-4

Model A

Gemini

Gemini 1.5 Pro

Model B

OpenAI

GPT-5.4

Overall leaderContenderLeading
Verified metric wins0 wins4 wins
Where it leadsNo dataCheapest input price, Free providers, Provider coverage, Recent tests
Model metadataNo OpenRouter metadata is available yet for this model.GPT-5.4 exposes 1.1M tokens; notable signals: Text input, Image input, File input, Text output.
DeveloperGoogleOpenAI
Context windowNo data1.1M tokens
Max outputNo data128K tokens
ReleasedNo dataMar 2026
ModalitiesNo data

Input

TextImageFile

Output

Text
FeaturesNone listed
Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning
ParametersNo dataNo data
TokenizerNo dataGPT
Knowledge cutoffNo dataNo data
OpenRouter IDNo dataopenai/gpt-5.4
ReferencesNo dataNo data

Benchmark score comparison

Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.

Metric
GeminiGemini 1.5 Pro
OpenAIGPT-5.4
GPQA
58.9%#105
92.0%#3
SciCode
29.5%#92
56.6%#3
HLE
4.9%#88
41.6%#4

API audit comparison

Latest completed audits from shared providers, with four safety and integrity score groups plus report links.

Provider
GeminiGemini 1.5 Pro
OpenAIGPT-5.4
No completed audits are available from shared providers yet.

Provider examples

Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.

Provider
GeminiGemini 1.5 Pro
OpenAIGPT-5.4
UoCode5 tests
Gemini

Gemini 1.5 Pro

models/gemini-1.5-pro

speed / latency

N/A / N/A

input / output

$0.014/M / $0.137/M

OpenAI

GPT-5.4

gpt-5.4-openai-compact

speed / latency

31 tok/s / 2364ms

input / output

$10.27/M / $61.64/M

天絮 API5 tests
Gemini

Gemini 1.5 Pro

speed / latency

N/A / N/A

input / output

No data

OpenAI

GPT-5.4

speed / latency

46 tok/s / 3291ms

input / output

No data

速创API5 tests
Gemini

Gemini 1.5 Pro

speed / latency

N/A / N/A

input / output

No data

OpenAI

GPT-5.4

speed / latency

50 tok/s / 1423ms

input / output

No data

AIGCBAR0 tests
Gemini

Gemini 1.5 Pro

speed / latency

N/A / N/A

input / output

No data

OpenAI

GPT-5.4

speed / latency

N/A / N/A

input / output

No data

AIO通用智能服务平台0 tests
Gemini

Gemini 1.5 Pro

speed / latency

N/A / N/A

input / output

No data

OpenAI

GPT-5.4

speed / latency

N/A / N/A

input / output

No data

Aitoke
Gemini

Gemini 1.5 Pro

models/gemini-1.5-pro

speed / latency

No data

input / output

$0.014/M / $0.137/M

OpenAI

GPT-5.4

gpt-5.4-openai-compact

speed / latency

No data

input / output

$10.27/M / $61.64/M

CHB API
Gemini

Gemini 1.5 Pro

gemini-1.5-pro-latest

speed / latency

No data

input / output

$0.017/M / $0.068/M

OpenAI

GPT-5.4

gpt-5.4-xhigh

speed / latency

No data

input / output

$0.034/M / $0.205/M

涵冰API
Gemini

Gemini 1.5 Pro

gemini-1.5-pro

speed / latency

No data

input / output

$0.020/M / $0.080/M

OpenAI

GPT-5.4

gpt-5.4

speed / latency

No data

input / output

$0.020/M / $0.120/M

When to choose each model

This report only uses LMSpeed data for Gemini 1.5 Pro and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.

Guidance
GeminiGemini 1.5 Pro
OpenAIGPT-5.4
When to choose each model

Gemini 1.5 Pro

Gemini 1.5 Pro does not clearly lead on the verified metrics here, so check provider-specific pricing before choosing.

GPT-5.4

GPT-5.4 is stronger when you prioritize Cheapest input price, Free providers, Provider coverage, Recent tests.

FAQ

TL;DR: GPT-5.4 leads across 60 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.

Why is this comparison indexable?
It has 4 verifiable comparison points, and both models have pricing or benchmark data.
Are missing metrics invented?
No. Metrics without LMSpeed data are omitted from this report.

Related compare reports

Continue from Gemini 1.5 Pro vs GPT-5.4 into nearby model comparisons with enough verified LMSpeed data.

ClaudeClaude Opus 4.6 vs Gemini 1.5 Pro4 verified data pointsGeminiGemini 1.5 Pro vs GPT-54 verified data pointsGeminiGemini 1.5 Pro vs GPT-5.24 verified data pointsGeminiGemini 1.5 Pro vs Gemini 2.5 Pro4 verified data points

Data as of Jun 13, 2026, 03:04 PM·Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.