Data points: 193
Model compare
The readout for Gemini 3.1 Pro and GPT-5.4, before the detailed comparison sheet.
Weighted outcome: GPT-5.4. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Decision read
GPT-5.4
GPT-5.4 has the higher weighted result; Model A / B score 38.3 to 61.7.
Evidence depth
193 data points
Includes 47 benchmark rows, 6 audit samples, and 7 provider examples.
Selection signal
Start with GPT-5.4
The charts below split 60 high-signal samples across speed, scores, and audit health.
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
This report only uses LMSpeed data for Gemini 3.1 Pro and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Model compare | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
| Overall leader | Contender | Leading |
| Weighted overall score | 38.3 pts | 61.7 pts |
| Benchmark category leads | 3 categories | 4 categories |
| Operational advantages | Average speed | Cheapest input price, First-token latency, Free providers, Provider coverage |
| Context window | 1.0M tokens | 1.1M tokens |
| Max output | 65.5K tokens | 128K tokens |
| Modalities | Input AudioFileImageTextvideo |
The overall result weights benchmark capability categories at 80% and price, API speed/latency, and availability at 20%. Recent test volume does not affect the winner, and missing benchmark categories are excluded.
| Model compare | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
| Developer | OpenAI | |
| Released | Feb 2026 | Mar 2026 |
| Parameters | No data | No data |
| Tokenizer | Gemini | GPT |
| Knowledge cutoff | No data | No data |
| OpenRouter ID | google/gemini-3.1-pro-preview | openai/gpt-5.4 |
| References | No data | No data |
This report only uses LMSpeed data for Gemini 3.1 Pro and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
Gemini 3.1 Pro
Gemini 3.1 Pro is stronger in benchmark categories (Reasoning, Multimodal, Instruction following) and operational dimensions (Average speed).
GPT-5.4
GPT-5.4 is stronger in benchmark categories (Agents, Coding, Knowledge, Math) and operational dimensions (Cheapest input price, First-token latency, Free providers, Provider coverage).
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.
Avg. score
Gemini 3.1 Pro
56.6
Avg. score
GPT-5.4
57.6
GPT-5.4 leads by 7.1
GPT-5.4 leads by 3.7
Gemini 3.1 Pro leads by 1.6
GPT-5.4 leads by 2.1
GPT-5.4 leads by 2.3
Gemini 3.1 Pro
Gemini 3.1 Pro leads by 2.3
Gemini 3.1 Pro leads by 1.3
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
Gemini 3.1 Pro
winner71.0
Rank #14/90 · confidence 3 · eval date 2026-02-19
GPT-5.4
67.0
Rank #22/90 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
72.7
Rank #13/94 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner74.0
Rank #6/94 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner77.1
Rank #6/16 · confidence 3 · eval date 2026-02-19
GPT-5.4
74.0
Rank #8/16 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner0.4
Rank #6/11 · confidence 3 · eval date 2026-02-19
GPT-5.4
0.2
Rank #8/11 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
17.7
Rank #13/77 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner23.4
Rank #8/77 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner81.5
Rank #12/27 · confidence 3 · eval date 2026-02-19
GPT-5.4
78.9
Rank #17/27 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
82.9
Rank #2/4 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner87.5
Rank #1/4 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
78.9
Rank #6/12 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner85.3
Rank #1/12 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner58.9
Rank #2/101 · confidence 3 · eval date 2026-02-19
GPT-5.4
56.6
Rank #5/101 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
32.0
Rank #13/33 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner67.4
Rank #3/33 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
68.8
Rank #16/64 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner71.0
Rank #13/64 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner61.4
Rank #16/71 · confidence 3 · eval date 2026-02-19
GPT-5.4
42.4
Rank #58/71 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
36.9
Rank #15/47 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner47.6
Rank #7/47 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
16.7
Rank #13/35 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner27.1
Rank #8/35 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
55.2
Rank #29/57 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner65.9
Rank #18/57 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner94.1
Rank #1/101 · confidence 3 · eval date 2026-02-19
GPT-5.4
92.0
Rank #13/101 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
20.6
Rank #5/7 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner40.1
Rank #1/7 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner71.5
Rank #1/4 · confidence 3 · eval date 2026-02-19
GPT-5.4
59.6
Rank #2/4 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner32.9
Rank #2/34 · confidence 3 · eval date 2026-02-19
GPT-5.4
5.7
Rank #22/34 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner94.3
Rank #2/25 · confidence 3 · eval date 2026-02-19
GPT-5.4
92.8
Rank #8/25 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner55.3
Rank #5/95 · confidence 3 · eval date 2026-02-19
GPT-5.4
50.0
Rank #11/95 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner45.4
Rank #5/18 · confidence 3 · eval date 2026-02-19
GPT-5.4
39.8
Rank #13/18 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner44.7
Rank #6/101 · confidence 3 · eval date 2026-02-19
GPT-5.4
41.6
Rank #10/101 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
46.5
Rank #17/104 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner51.4
Rank #11/104 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
49.9
Rank #71/95 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner88.6
Rank #18/95 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
66.8
Rank #34/60 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner77.3
Rank #18/60 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner81.3
Rank #1/5 · confidence 3 · eval date 2026-02-19
GPT-5.4
77.1
Rank #2/5 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
29.0
Rank #2/3 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner41.0
Rank #1/3 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner69.4
Rank #2/6 · confidence 3 · eval date 2026-02-19
GPT-5.4
65.4
Rank #3/6 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner83.9
Rank #2/28 · confidence 3 · eval date 2026-02-19
GPT-5.4
81.2
Rank #6/28 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
84.4
Rank #3/9 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner85.4
Rank #2/9 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner72.4
Rank #3/7 · confidence 3 · eval date 2026-02-19
GPT-5.4
61.1
Rank #4/7 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner82.4
Rank #5/61 · confidence 3 · eval date 2026-02-19
GPT-5.4
78.4
Rank #19/61 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner81.9
Rank #7/40 · confidence 3 · eval date 2026-02-19
GPT-5.4
68.5
Rank #17/40 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
80.2
Rank #16/24 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner82.8
Rank #8/24 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner1276.0
Rank #24/69 · confidence 3 · eval date 2026-02-19
GPT-5.4
1245.0
Rank #35/69 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
winner77.1
Rank #10/86 · confidence 3 · eval date 2026-02-19
GPT-5.4
73.9
Rank #24/86 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
95.6
Rank #17/84 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner98.9
Rank #2/84 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
56.9
Rank #14/50 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner64.9
Rank #4/50 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
32.0
Rank #9/24 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner33.3
Rank #7/24 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
69.7
Rank #10/11 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner73.6
Rank #9/11 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
21.4
Rank #40/60 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner41.1
Rank #13/60 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
57.8
Rank #17/28 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner60.3
Rank #13/28 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
23.2
Rank #42/55 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner44.6
Rank #14/55 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
965.0
Rank #42/60 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner1392.0
Rank #14/60 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
13.3
Rank #18/19 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner15.3
Rank #14/19 · confidence 3 · eval date 2026-03-05
Gemini 3.1 Pro
74.0
Rank #18/59 · confidence 3 · eval date 2026-02-19
GPT-5.4
winner74.7
Rank #17/59 · confidence 3 · eval date 2026-03-05
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
Winner: GPT-5.4 | Gemini 3.1 Pro gemini-3.1-pro-preview No audit yet | GPT-5.4 gpt-5.4 Audit score 100 100100100100 |
Winner: GPT-5.4 | Gemini 3.1 Pro gemini-3.1-pro-preview Audit score 87 848480100 | GPT-5.4 gpt-5.4 Audit score 93 100 |
Winner: GPT-5.4 | Gemini 3.1 Pro gemini-3.1-pro-low No audit yet | GPT-5.4 gpt-5.4 Audit score 90 1008476100 |
Winner: GPT-5.4 | Gemini 3.1 Pro gemini-3.1-pro No audit yet | GPT-5.4 gpt-5.4 Audit score 88 8468100100 |
Winner: Gemini 3.1 Pro | Gemini 3.1 Pro gemini-3.1-pro-preview Audit score 83 787280100 | GPT-5.4 gpt-5.4 No audit yet |
Winner: Gemini 3.1 Pro | Gemini 3.1 Pro gemini-3.1-pro-preview Audit score 79 698463100 | GPT-5.4 gpt-5.4 No audit yet |
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Gemini 3.1 Pro | GPT-5.4 |
|---|---|---|
50 tests | Gemini 3.1 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 50 tok/s / 7305ms input / output No data |
20 tests | Gemini 3.1 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 49 tok/s / 5435ms input / output No data |
15 tests | Gemini 3.1 Pro speed / latency 102 tok/s / 12933ms input / output No data | GPT-5.4 speed / latency 71 tok/s / 1629ms input / output No data |
15 tests | Gemini 3.1 Pro speed / latency 101 tok/s / 15025ms input / output No data | GPT-5.4 speed / latency 44 tok/s / 2518ms input / output No data |
10 tests | Gemini 3.1 Pro speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 51 tok/s / 2526ms input / output No data |
Gemini 3.1 Pro gemini-3.1-pro-preview speed / latency No data input / output $0/M/$0/M | GPT-5.4 gpt-5.4-openai-compact speed / latency No data input / output $0/M | |
Gemini 3.1 Pro gemini-3.1-pro-preview speed / latency No data input / output $0/request | GPT-5.4 gpt-5.4 speed / latency No data input / output $0/request |
Weighted outcome: GPT-5.4. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Output
Input TextImageFile Output Text |
| Features | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning |
|---|
