Data points: 160
Model compare
The readout for Gemini 3.5 Flash and GPT-5.4, before the detailed comparison sheet.
Weighted outcome: GPT-5.4. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Decision read
GPT-5.4
GPT-5.4 has the higher weighted result; Model A / B score 34.3 to 65.7.
Evidence depth
160 data points
Includes 46 benchmark rows, 1 audit samples, and 9 provider examples.
Selection signal
Start with GPT-5.4
The charts below split 56 high-signal samples across speed, scores, and audit health.
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
This report only uses LMSpeed data for Gemini 3.5 Flash and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Model compare | Gemini 3.5 Flash | GPT-5.4 |
|---|---|---|
| Overall leader | Contender | Leading |
| Weighted overall score | 34.3 pts | 65.7 pts |
| Benchmark category leads | 3 categories | 4 categories |
| Operational advantages | No data | Cheapest input price, Free providers, Provider coverage |
| Context window | 1.0M tokens | 1.1M tokens |
| Max output | 65.5K tokens | 128K tokens |
| Modalities | Input TextImagevideoFileAudio Output |
The overall result weights benchmark capability categories at 80% and price, API speed/latency, and availability at 20%. Recent test volume does not affect the winner, and missing benchmark categories are excluded.
| Model compare | Gemini 3.5 Flash | GPT-5.4 |
|---|---|---|
| Developer | OpenAI | |
| Released | May 2026 | Mar 2026 |
| Parameters | No data | No data |
| Tokenizer | Gemini | GPT |
| Knowledge cutoff | 2025-01-01 | No data |
| OpenRouter ID | google/gemini-3.5-flash | openai/gpt-5.4 |
| References | No data | No data |
This report only uses LMSpeed data for Gemini 3.5 Flash and GPT-5.4: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
Gemini 3.5 Flash
Gemini 3.5 Flash leads these benchmark categories: Agents, Multimodal, Instruction following.
GPT-5.4
GPT-5.4 is stronger in benchmark categories (Coding, Reasoning, Knowledge, Math) and operational dimensions (Cheapest input price, Free providers, Provider coverage).
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.
Avg. score
Gemini 3.5 Flash
56.3
Avg. score
GPT-5.4
57.8
Gemini 3.5 Flash leads by 2.9
GPT-5.4 leads by 8.2
GPT-5.4 leads by 4.9
GPT-5.4 leads by 3.8
GPT-5.4 leads by 2.5
No data
Gemini 3.5 Flash leads by 4.8
Gemini 3.5 Flash leads by 1.0
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
Gemini 3.5 Flash
winner71.0
Rank #16/83 · confidence 4 · eval date 2026-05-19
GPT-5.4
67.0
Rank #19/83 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner240.1 tok/s
Rank #9/139 · confidence 4
GPT-5.4
96.3 tok/s
Rank #60/139 · confidence 4
Gemini 3.5 Flash
10.48 s
Rank #75/139 · confidence 4
GPT-5.4
winner0.67 s
Rank #22/139 · confidence 4
Gemini 3.5 Flash
10.48 s
Rank #117/139 · confidence 4
GPT-5.4
winner0.67 s
Rank #30/139 · confidence 4
Gemini 3.5 Flash
winner$3.38/M
Rank #118/163 · confidence 4
GPT-5.4
$5.63/M
Rank #137/163 · confidence 4
Gemini 3.5 Flash
winner$1.50/M
Rank #120/163 · confidence 4
GPT-5.4
$2.50/M
Rank #133/163 · confidence 4
Gemini 3.5 Flash
winner$9.00/M
Rank #121/163 · confidence 4
GPT-5.4
$15.00/M
Rank #138/163 · confidence 4
Gemini 3.5 Flash
69.3
Rank #22/89 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner74.0
Rank #5/89 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
13.1
Rank #16/73 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner23.4
Rank #7/73 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner92.2%
Rank #9/187 · confidence 4
GPT-5.4
74.8%
Rank #96/187 · confidence 4
Gemini 3.5 Flash
winner41.0%
Rank #9/186 · confidence 4
GPT-5.4
10.6%
Rank #90/186 · confidence 4
Gemini 3.5 Flash
53.1
Rank #15/96 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner56.6
Rank #3/96 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
48.7
Rank #9/33 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner67.4
Rank #3/33 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
70.1
Rank #11/58 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner71.0
Rank #10/58 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner53.1%
Rank #11/184 · confidence 4
GPT-5.4
47.1%
Rank #23/184 · confidence 4
Gemini 3.5 Flash
55.1
Rank #27/37 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner57.7
Rank #15/37 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner58.5
Rank #28/64 · confidence 4 · eval date 2026-05-19
GPT-5.4
46.7
Rank #51/64 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
39.0
Rank #12/47 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner47.6
Rank #7/47 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
14.6
Rank #14/35 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner27.1
Rank #8/35 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
56.0
Rank #27/56 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner65.9
Rank #17/56 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner22.7
Rank #6/29 · confidence 4 · eval date 2026-05-19
GPT-5.4
5.7
Rank #18/29 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
41.0
Rank #8/96 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner41.6
Rank #7/96 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner51.9
Rank #7/90 · confidence 4 · eval date 2026-05-19
GPT-5.4
50.0
Rank #10/90 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
92.7
Rank #8/23 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner92.8
Rank #7/23 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner92.2
Rank #9/96 · confidence 4 · eval date 2026-05-19
GPT-5.4
92.0
Rank #10/96 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
50.2
Rank #12/99 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner51.4
Rank #9/99 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
66.2
Rank #32/54 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner82.0
Rank #11/54 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
60.7
Rank #62/90 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner88.6
Rank #19/90 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner84.3
Rank #1/57 · confidence 4 · eval date 2026-05-19
GPT-5.4
78.4
Rank #15/57 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner83.6
Rank #3/26 · confidence 4 · eval date 2026-05-19
GPT-5.4
81.2
Rank #5/26 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner84.0
Rank #4/34 · confidence 4 · eval date 2026-05-19
GPT-5.4
68.9
Rank #13/34 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner84.2
Rank #5/21 · confidence 4 · eval date 2026-05-19
GPT-5.4
82.8
Rank #6/21 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner1287.0
Rank #18/65 · confidence 4 · eval date 2026-05-19
GPT-5.4
1252.0
Rank #30/65 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner76.3
Rank #13/86 · confidence 4 · eval date 2026-05-19
GPT-5.4
73.9
Rank #24/86 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner47.1
Rank #1/21 · confidence 4 · eval date 2026-05-19
GPT-5.4
33.3
Rank #4/21 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner83.6
Rank #1/22 · confidence 4 · eval date 2026-05-19
GPT-5.4
70.6
Rank #12/22 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner56.5
Rank #3/21 · confidence 4 · eval date 2026-05-19
GPT-5.4
54.6
Rank #5/21 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
61.9
Rank #10/50 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner64.9
Rank #4/50 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner78.4
Rank #5/21 · confidence 4 · eval date 2026-05-19
GPT-5.4
75.0
Rank #7/21 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner18.0
Rank #8/19 · confidence 4 · eval date 2026-05-19
GPT-5.4
15.3
Rank #14/19 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner76.2
Rank #10/45 · confidence 4 · eval date 2026-05-19
GPT-5.4
75.1
Rank #11/45 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
37.5
Rank #12/54 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner41.1
Rank #11/54 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
1349.0
Rank #13/54 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner1395.0
Rank #11/54 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
42.4
Rank #13/50 · confidence 4 · eval date 2026-05-19
GPT-5.4
winner44.7
Rank #11/50 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner77.7
Rank #12/52 · confidence 4 · eval date 2026-05-19
GPT-5.4
74.7
Rank #13/52 · confidence 3 · eval date 2026-03-05
Gemini 3.5 Flash
winner95.3
Rank #17/84 · confidence 4 · eval date 2026-05-19
GPT-5.4
87.1
Rank #37/84 · confidence 3 · eval date 2026-03-05
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Gemini 3.5 Flash | GPT-5.4 |
|---|---|---|
Winner: GPT-5.4 | Gemini 3.5 Flash gemini-3.5-flash No audit yet | GPT-5.4 gpt-5.4 Audit score 88 8468100100 |
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Gemini 3.5 Flash | GPT-5.4 |
|---|---|---|
10 tests | Gemini 3.5 Flash speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 88 tok/s / 6075ms input / output No data |
5 tests | Gemini 3.5 Flash speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 50 tok/s / 5476ms input / output No data |
5 tests | Gemini 3.5 Flash speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 70 tok/s / 2961ms input / output No data |
5 tests | Gemini 3.5 Flash speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 44 tok/s / 3441ms input / output No data |
5 tests | Gemini 3.5 Flash speed / latency N/A / N/A input / output No data | GPT-5.4 speed / latency 44 tok/s / 1119ms input / output No data |
Gemini 3.5 Flash gemini-3.5-flash speed / latency No data input / output $0/M/$0/M | GPT-5.4 gpt-5.4 speed / latency No data input / output $0.240/M | |
Gemini 3.5 Flash gemini-3.5-flash speed / latency No data input / output $0/request | GPT-5.4 gpt-5.4 speed / latency No data input / output $0/request | |
Gemini 3.5 Flash gemini-3.5-flash-c speed / latency No data input / output $0.0027/request | GPT-5.4 gpt-5.4 speed / latency No data input / output $69.86/M | |
Gemini 3.5 Flash gemini-3.5-flash-low speed / latency No data input / output $0.010/request | GPT-5.4 gpt-5-4 speed / latency No data input / output $0.080/request |
Weighted outcome: GPT-5.4. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Input TextImageFile Output Text |
| Features | Text inputImage inputFile inputAudio inputText outputTool callingStructured outputsJSON modeReasoning | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning |
|---|
