Data points: 158
Model compare
The readout for Claude Sonnet 4.6 and GPT-5.4 Mini, before the detailed comparison sheet.
Weighted outcome: GPT-5.4 Mini. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Decision read
GPT-5.4 Mini
GPT-5.4 Mini has the higher weighted result; Model A / B score 38.3 to 61.7.
Evidence depth
158 data points
Includes 29 benchmark rows, 6 audit samples, and 7 provider examples.
Selection signal
Start with GPT-5.4 Mini
The charts below split 42 high-signal samples across speed, scores, and audit health.
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
This report only uses LMSpeed data for Claude Sonnet 4.6 and GPT-5.4 Mini: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Model compare | Claude Sonnet 4.6 | GPT-5.4 Mini |
|---|---|---|
| Overall leader | Contender | Leading |
| Weighted overall score | 38.3 pts | 61.7 pts |
| Benchmark category leads | 3 categories | 4 categories |
| Operational advantages | No data | Average speed, First-token latency, Provider coverage |
| Context window | 1M tokens | 400K tokens |
| Max output | 128K tokens | 128K tokens |
| Modalities | Input TextImageFile Output Text |
The overall result weights benchmark capability categories at 80% and price, API speed/latency, and availability at 20%. Recent test volume does not affect the winner, and missing benchmark categories are excluded.
| Model compare | Claude Sonnet 4.6 | GPT-5.4 Mini |
|---|---|---|
| Developer | Anthropic | OpenAI |
| Released | Feb 2026 | Mar 2026 |
| Parameters | No data | No data |
| Tokenizer | Claude | GPT |
| Knowledge cutoff | No data | 2025-08-31 |
| OpenRouter ID | anthropic/claude-sonnet-4.6 | openai/gpt-5.4-mini |
| References | No data | No data |
This report only uses LMSpeed data for Claude Sonnet 4.6 and GPT-5.4 Mini: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
Claude Sonnet 4.6
Claude Sonnet 4.6 leads these benchmark categories: Agents, Knowledge, Math.
GPT-5.4 Mini
GPT-5.4 Mini is stronger in benchmark categories (Coding, Reasoning, Multimodal, Instruction following) and operational dimensions (Average speed, First-token latency, Provider coverage).
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.
Avg. score
Claude Sonnet 4.6
53.2
Avg. score
GPT-5.4 Mini
51.9
Claude Sonnet 4.6 leads by 2.3
GPT-5.4 Mini leads by 1.7
GPT-5.4 Mini leads by 6.2
Claude Sonnet 4.6 leads by 23.2
Claude Sonnet 4.6 leads by 3.5
No data
GPT-5.4 Mini leads by 1.8
GPT-5.4 Mini leads by 10.3
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
Claude Sonnet 4.6
winner63.0
Rank #25/84 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
58.0
Rank #36/84 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
$6.00/M
Rank #137/162 · confidence 4
GPT-5.4 Mini
winner$1.69/M
Rank #95/162 · confidence 4
Claude Sonnet 4.6
$3.00/M
Rank #137/162 · confidence 4
GPT-5.4 Mini
winner$0.750/M
Rank #95/162 · confidence 4
Claude Sonnet 4.6
$15.00/M
Rank #136/162 · confidence 4
GPT-5.4 Mini
winner$4.50/M
Rank #102/162 · confidence 4
Claude Sonnet 4.6
0.9
Rank #60/73 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner10.0
Rank #21/73 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
57.7
Rank #63/89 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner69.3
Rank #23/89 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner87.5%
Rank #31/188 · confidence 4
GPT-5.4 Mini
82.3%
Rank #64/188 · confidence 4
Claude Sonnet 4.6
winner30.0%
Rank #31/187 · confidence 4
GPT-5.4 Mini
17.1%
Rank #65/187 · confidence 4
Claude Sonnet 4.6
24.3
Rank #8/8 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner27.0
Rank #6/8 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner51.5
Rank #7/33 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
48.0
Rank #10/33 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner63.7
Rank #8/65 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
54.3
Rank #30/65 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
46.9
Rank #33/96 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner49.9
Rank #23/96 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner46.8%
Rank #29/185 · confidence 4
GPT-5.4 Mini
44.2%
Rank #38/185 · confidence 4
Claude Sonnet 4.6
winner32.4
Rank #18/47 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
28.3
Rank #20/47 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner8.3
Rank #19/35 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
2.1
Rank #35/35 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner49.5
Rank #31/56 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
44.7
Rank #32/56 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
65.9
Rank #57/90 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner89.8
Rank #13/90 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner76.9
Rank #18/55 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
60.2
Rank #39/55 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
winner38.0
Rank #29/90 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
37.5
Rank #32/90 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
35.9
Rank #43/99 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner40.0
Rank #31/99 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
79.9
Rank #63/96 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner87.5
Rank #34/96 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
13.2
Rank #63/96 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner26.6
Rank #38/96 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
57.5
Rank #25/35 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner59.2
Rank #24/35 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
70.6
Rank #40/57 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner73.3
Rank #33/57 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
41.2
Rank #69/86 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner73.3
Rank #26/86 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
72.1
Rank #11/21 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
72.1
Rank #11/21 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
59.1
Rank #30/46 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner60.0
Rank #26/46 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
55.0
Rank #30/53 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner55.7
Rank #29/53 · confidence 3 · eval date 2026-03-17
Claude Sonnet 4.6
79.5
Rank #55/84 · confidence 3 · eval date 2026-02-01
GPT-5.4 Mini
winner83.3
Rank #49/84 · confidence 3 · eval date 2026-03-17
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | Claude Sonnet 4.6 | GPT-5.4 Mini |
|---|---|---|
Winner: Claude Sonnet 4.6 | Claude Sonnet 4.6 claude-sonnet-4-6 Audit score 97 10010086100 | GPT-5.4 Mini gpt-5.4-mini No audit yet |
Winner: GPT-5.4 Mini | Claude Sonnet 4.6 claude-sonnet-4-6 No audit yet | GPT-5.4 Mini gpt-5.4-mini Audit score 97 10010086100 |
Winner: Claude Sonnet 4.6 | Claude Sonnet 4.6 claude-sonnet-4-6 Audit score 94 76100100100 | GPT-5.4 Mini gpt-5.4-mini No audit yet |
Winner: Claude Sonnet 4.6 | Claude Sonnet 4.6 claude-sonnet-4-6 Audit score 94 76100100100 | GPT-5.4 Mini gpt-5.4-mini Audit score 93 100 |
Winner: GPT-5.4 Mini | Claude Sonnet 4.6 claude-sonnet-4-6 No audit yet | GPT-5.4 Mini gpt-5.4-mini Audit score 93 1008486100 |
Winner: Claude Sonnet 4.6 | Claude Sonnet 4.6 claude-sonnet-4-6 Audit score 91 64100100100 | GPT-5.4 Mini gpt-5.4-mini No audit yet |
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | Claude Sonnet 4.6 | GPT-5.4 Mini |
|---|---|---|
25 tests | Claude Sonnet 4.6 speed / latency 32 tok/s / 6074ms input / output No data | GPT-5.4 Mini speed / latency N/A / N/A input / output No data |
25 tests | Claude Sonnet 4.6 speed / latency N/A / N/A input / output No data | GPT-5.4 Mini speed / latency 139 tok/s / 2844ms input / output No data |
25 tests | Claude Sonnet 4.6 speed / latency 40 tok/s / 3145ms input / output No data | GPT-5.4 Mini speed / latency N/A / N/A input / output No data |
15 tests | Claude Sonnet 4.6 speed / latency 48 tok/s / 1587ms input / output No data | GPT-5.4 Mini speed / latency 95 tok/s / 2343ms input / output No data |
10 tests | Claude Sonnet 4.6 speed / latency N/A / N/A input / output No data | GPT-5.4 Mini speed / latency 181 tok/s / 3275ms input / output No data |
Claude Sonnet 4.6 claude-sonnet-4-6 speed / latency No data input / output $0/M/$0/M | GPT-5.4 Mini gpt-5.4-mini speed / latency No data input / output $0/M | |
Claude Sonnet 4.6 claude-sonnet-4-6 speed / latency No data input / output $0/request | GPT-5.4 Mini gpt-5.4-mini speed / latency No data input / output $0/request |
Weighted outcome: GPT-5.4 Mini. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Input
Output
| Features | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning |
|---|
