Data points: 160
Model compare
Gemini 3.1 Pro vs GPT-5.4
The readout for Gemini 3.1 Pro and GPT-5.4, before the detailed comparison sheet.
Key Takeaways
Weighted outcome: GPT-5.4. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Decision read
GPT-5.4
GPT-5.4 has the higher weighted result; Model A / B score 38.3 to 61.7.
Evidence depth
160 data points
Includes 48 benchmark rows, 0 audit samples, and 10 provider examples.
Selection signal
Start with GPT-5.4
The charts below split 58 high-signal samples across speed, scores, and audit health.
Change comparison
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
Comparison sheet
This report only uses LMSpeed data for Gemini 3.1 Pro and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Model compare | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
| Overall leader | Contender | Leading |
| Weighted overall score | 38.3 pts | 61.7 pts |
| Benchmark category leads | 3 categories | 4 categories |
| Operational advantages | Average speed | Cheapest input price, First-token latency, Free providers, Provider coverage |
| Context window | 1.0M tokens | 1.1M tokens |
| Max output | 65.5K tokens | 128K tokens |
| Modalities | Input AudioFileImageTextvideo Output Text | Input TextImageFile Output Text |
| Features | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning |
The overall result weights benchmark capability categories at 80% and price, API speed/latency, and availability at 20%. Recent test volume does not affect the winner, and missing benchmark categories are excluded.
Model metadata
Model metadata
| Model compare | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
| Developer | OpenAI | |
| Released | Feb 2026 | Mar 2026 |
| Parameters | No data | No data |
| Tokenizer | Gemini | GPT |
| Knowledge cutoff | No data | No data |
| OpenRouter ID | google/gemini-3.1-pro-preview | openai/gpt-5.4 |
| References | No data | No data |
When to choose each model
This report only uses LMSpeed data for Gemini 3.1 Pro and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
Gemini 3.1 Pro
Gemini 3.1 Pro is stronger in benchmark categories (Reasoning, Multimodal, Instruction following) and operational dimensions (Average speed).
GPT-5.4
GPT-5.4 is stronger in benchmark categories (Agents, Coding, Knowledge, Math) and operational dimensions (Cheapest input price, First-token latency, Free providers, Provider coverage).
Benchmark score comparison
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Category performance
Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.
- Model A coverage
- 8 / 8
- Model B coverage
- 7 / 8
- Shared
- 7 shared categories
Avg. score
Gemini 3.1 Pro
57
Avg. score
GPT-5.4
56.6
Agents
GPT-5.4 leads by 6.1
Coding
GPT-5.4 leads by 5.0
Reasoning
Gemini 3.1 Pro leads by 1.7
Knowledge
GPT-5.4 leads by 1.5
Math
GPT-5.4 leads by 2.2
Multilingual
Gemini 3.1 Pro
Multimodal
Gemini 3.1 Pro leads by 2.6
Instruction following
Gemini 3.1 Pro leads by 1.3
Professional benchmark details
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
Professional benchmark details
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
Gemini 3.1 Pro
winner67.0
Rank #27/112 · confidence 3 · eval date 2026-02-19
GPT-5.4
63.0
Rank #41/112 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner0.4
Rank #7/12 · confidence 3 · eval date 2026-02-19
GPT-5.4
0.2
Rank #9/12 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner77.1
Rank #8/19 · confidence 3 · eval date 2026-02-19
GPT-5.4
74.0
Rank #10/19 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
17.7
Rank #19/88 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner23.4
Rank #11/88 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
82.0
Rank #14/106 · confidence 3 · eval date 2026-02-19
GPT-5.4
82.0
Rank #14/106 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
50.6
Rank #60/67 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner57.2
Rank #51/67 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
82.9
Rank #2/4 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner87.5
Rank #1/4 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
78.9
Rank #6/12 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner85.3
Rank #1/12 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
32.0
Rank #13/33 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner67.4
Rank #3/33 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner46.3
Rank #5/25 · confidence 3 · eval date 2026-02-19
GPT-5.4
38.5
Rank #9/25 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner58.7
Rank #6/113 · confidence 3 · eval date 2026-02-19
GPT-5.4
56.6
Rank #10/113 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner74.3
Rank #7/87 · confidence 3 · eval date 2026-02-19
GPT-5.4
42.8
Rank #69/87 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
68.8
Rank #25/75 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner71.0
Rank #21/75 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
36.9
Rank #15/47 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner47.6
Rank #7/47 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
16.7
Rank #14/36 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner27.1
Rank #9/36 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
54.3
Rank #35/63 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner64.5
Rank #24/63 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
20.6
Rank #6/8 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner40.1
Rank #1/8 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner71.5
Rank #1/4 · confidence 3 · eval date 2026-02-19
GPT-5.4
59.6
Rank #2/4 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner94.3
Rank #3/32 · confidence 3 · eval date 2026-02-19
GPT-5.4
92.8
Rank #9/32 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner94.1
Rank #5/113 · confidence 3 · eval date 2026-02-19
GPT-5.4
92.0
Rank #21/113 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner31.9
Rank #5/45 · confidence 3 · eval date 2026-02-19
GPT-5.4
5.8
Rank #28/45 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner45.4
Rank #6/22 · confidence 3 · eval date 2026-02-19
GPT-5.4
39.8
Rank #15/22 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner54.9
Rank #9/106 · confidence 3 · eval date 2026-02-19
GPT-5.4
50.8
Rank #15/106 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner47.0
Rank #10/114 · confidence 3 · eval date 2026-02-19
GPT-5.4
43.7
Rank #15/114 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
50.9
Rank #76/106 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner91.7
Rank #13/106 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner79.2
Rank #20/83 · confidence 3 · eval date 2026-02-19
GPT-5.4
74.3
Rank #30/83 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
30.4
Rank #48/117 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner39.0
Rank #29/117 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner81.3
Rank #1/6 · confidence 3 · eval date 2026-02-19
GPT-5.4
77.1
Rank #3/6 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
29.0
Rank #2/4 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner41.0
Rank #1/4 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner83.9
Rank #2/31 · confidence 3 · eval date 2026-02-19
GPT-5.4
81.2
Rank #7/31 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner69.4
Rank #3/8 · confidence 3 · eval date 2026-02-19
GPT-5.4
65.4
Rank #5/8 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
84.4
Rank #5/12 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner85.4
Rank #3/12 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner72.4
Rank #4/8 · confidence 3 · eval date 2026-02-19
GPT-5.4
61.1
Rank #5/8 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner82.4
Rank #8/68 · confidence 3 · eval date 2026-02-19
GPT-5.4
78.4
Rank #23/68 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
80.2
Rank #21/30 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner82.8
Rank #12/30 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner79.2
Rank #14/56 · confidence 3 · eval date 2026-02-19
GPT-5.4
69.3
Rank #28/56 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner1265.0
Rank #32/78 · confidence 3 · eval date 2026-02-19
GPT-5.4
1232.0
Rank #42/78 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner77.1
Rank #7/84 · confidence 3 · eval date 2026-02-19
GPT-5.4
73.9
Rank #21/84 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
95.6
Rank #17/82 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner98.9
Rank #2/82 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
56.9
Rank #14/49 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner64.9
Rank #4/49 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
32.0
Rank #9/23 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner33.3
Rank #7/23 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
69.7
Rank #13/14 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner73.6
Rank #12/14 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
57.8
Rank #16/27 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner60.3
Rank #13/27 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
13.3
Rank #17/18 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner15.3
Rank #13/18 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
10.3
Rank #55/70 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner44.2
Rank #14/70 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
20.2
Rank #54/66 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner40.3
Rank #26/66 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
904.0
Rank #55/72 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner1307.0
Rank #26/72 · confidence 4 · eval date 2026-03-05
Gemini 3.1 Pro
winner72.8
Rank #28/77 · confidence 3 · eval date 2026-02-19
GPT-5.4
72.0
Rank #29/77 · confidence 4 · eval date 2026-03-05
API audit comparison
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
API audit comparison
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
| No completed audits are available from shared providers yet. | ||
Provider examples
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
Provider examples
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
天宫造物50 tests | Gemini 3.1 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 50 tok/s / 7305ms input / output No data |
星见雅 API20 tests | Gemini 3.1 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 49 tok/s / 5435ms input / output No data |
6345ywz API15 tests | Gemini 3.1 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 41 tok/s / 6581ms input / output No data |
TradingBase API15 tests | Gemini 3.1 Pro speed / latency 102 tok/s / 12933ms input / output No data | GPT-5.4 speed / latency 71 tok/s / 1629ms input / output No data |
小水管 API15 tests | Gemini 3.1 Pro speed / latency 101 tok/s / 15025ms input / output No data | GPT-5.4 speed / latency 44 tok/s / 2518ms input / output No data |
Gemini 3.1 Pro gemini-3.1-pro-high speed / latency No data input / output $0.700/M/$4.20/M | GPT-5.4 gpt-5.4-2026-03-05 speed / latency No data input / output $0/M/$0/M | |
Gemini 3.1 Pro gemini-3.1-pro-preview speed / latency No data input / output $1.53/M/$9.21/M | GPT-5.4 gpt-5.4 speed / latency No data input / output $0/M/$0/M | |
Gemini 3.1 Pro gemini-3.1-pro speed / latency No data input / output $0/M/$0/M | GPT-5.4 gpt-5.4 speed / latency No data input / output $0/M/$0/M | |
Gemini 3.1 Pro gemini-3.1-pro-preview speed / latency No data input / output $0/request | GPT-5.4 gpt-5.4-openai-compact speed / latency No data input / output $0/request | |
Gemini 3.1 Pro gemini-3.1-pro-preview speed / latency No data input / output $0.0052/request | GPT-5.4 gpt-5.4 speed / latency No data input / output $0.014/request |
FAQ
Weighted outcome: GPT-5.4. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
- Why is this comparison indexable?
- It has 6 verifiable comparison points, and both models have pricing or benchmark data.
- Are missing metrics invented?
- No. Metrics without LMSpeed data are omitted from this report.