Data points: 102
Model compare
The readout for O1 and O3 Mini, before the detailed comparison sheet.
Weighted outcome: O1. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Decision read
O1
O1 has the higher weighted result; Model A / B score 53.3 to 46.7.
Evidence depth
102 data points
Includes 19 benchmark rows, 0 audit samples, and 8 provider examples.
Selection signal
Start with O1
The charts below split 27 high-signal samples across speed, scores, and audit health.
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
This report only uses LMSpeed data for O1 and O3 Mini: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Model compare | O1 | O3 Mini |
|---|---|---|
| Overall leader | Leading | Contender |
| Weighted overall score | 53.3 pts | 46.7 pts |
| Benchmark category leads | 4 categories | 2 categories |
| Operational advantages | No data | Cheapest input price, Free providers, Provider coverage |
| Context window | 200K tokens | 200K tokens |
| Max output | 100K tokens | 100K tokens |
| Modalities | Input TextImageFile Output Text | Input |
The overall result weights benchmark capability categories at 80% and price, API speed/latency, and availability at 20%. Recent test volume does not affect the winner, and missing benchmark categories are excluded.
| Model compare | O1 | O3 Mini |
|---|---|---|
| Developer | OpenAI | OpenAI |
| Released | Dec 2024 | Feb 2025 |
| Parameters | No data | No data |
| Tokenizer | GPT | GPT |
| Knowledge cutoff | 2023-10-31 | 2023-10-31 |
| OpenRouter ID | openai/o1 | openai/o3-mini |
| References | No data | No data |
This report only uses LMSpeed data for O1 and O3 Mini: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
O1
O1 leads these benchmark categories: Agents, Coding, Reasoning, Knowledge.
O3 Mini
O3 Mini is stronger in benchmark categories (Math, Instruction following) and operational dimensions (Cheapest input price, Free providers, Provider coverage).
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.
Avg. score
O1
52.5
Avg. score
O3 Mini
48.8
O1 leads by 6.1
O1 leads by 10.2
O1 leads by 0.9
O1 leads by 14.7
O3 Mini leads by 6.0
No data
No data
O3 Mini leads by 3.9
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
O1
$60.00/M
Rank #155/162 · confidence 4
O3 Mini
winner$4.40/M
Rank #98/162 · confidence 4
O1
$26.25/M
Rank #155/162 · confidence 4
O3 Mini
winner$1.93/M
Rank #99/162 · confidence 4
O1
$15.00/M
Rank #155/162 · confidence 4
O3 Mini
winner$1.10/M
Rank #103/162 · confidence 4
O1
winner84.1%
Rank #30/125 · confidence 4
O3 Mini
79.1%
Rank #69/125 · confidence 4
O1
74.7%
Rank #99/187 · confidence 4
O3 Mini
winner74.8%
Rank #96/187 · confidence 4
O1
7.7%
Rank #107/186 · confidence 4
O3 Mini
winner8.7%
Rank #97/186 · confidence 4
O1
67.9%
Rank #34/115 · confidence 4
O3 Mini
winner71.7%
Rank #27/115 · confidence 4
O1
35.8
Rank #75/96 · confidence 1 · eval date 2024-12-01
O3 Mini
winner39.9
Rank #59/96 · confidence 1 · eval date 2025-01-31
O1
35.8%
Rank #106/184 · confidence 4
O3 Mini
winner39.9%
Rank #69/184 · confidence 4
O1
97.0%
Rank #13/72 · confidence 4
O3 Mini
winner97.3%
Rank #11/72 · confidence 4
O1
72.3%
Rank #19/68 · confidence 4
O3 Mini
winner77.0%
Rank #14/68 · confidence 4
O1
winner91.8
Rank #1/5 · confidence 1 · eval date 2024-12-01
O3 Mini
86.9
Rank #4/5 · confidence 1 · eval date 2025-01-31
O1
64.4
Rank #35/54 · confidence 1 · eval date 2024-12-01
O3 Mini
winner65.9
Rank #33/54 · confidence 1 · eval date 2025-01-31
O1
74.7
Rank #73/96 · confidence 1 · eval date 2024-12-01
O3 Mini
winner74.8
Rank #71/96 · confidence 1 · eval date 2025-01-31
O1
7.7
Rank #73/96 · confidence 1 · eval date 2024-12-01
O3 Mini
winner8.7
Rank #71/96 · confidence 1 · eval date 2025-01-31
O1
17.0
Rank #79/99 · confidence 1 · eval date 2024-09-12
O3 Mini
winner19.0
Rank #77/99 · confidence 1 · eval date 2025-01-31
O1
85.4
Rank #14/26 · confidence 1 · eval date 2024-12-01
O3 Mini
winner90.3
Rank #5/26 · confidence 1 · eval date 2025-01-31
O1
92.2
Rank #10/16 · confidence 1 · eval date 2024-12-01
O3 Mini
winner93.9
Rank #5/16 · confidence 1 · eval date 2025-01-31
O1
winner62.6
Rank #62/84 · confidence 1 · eval date 2024-12-01
O3 Mini
28.7
Rank #74/84 · confidence 1 · eval date 2025-01-31
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | O1 | O3 Mini |
|---|---|---|
| No completed audits are available from shared providers yet. | ||
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | O1 | O3 Mini |
|---|---|---|
6 tests | O1 speed / latency N/A / N/A input / output No data | O3 Mini speed / latency 44 tok/s / 17418ms input / output No data |
5 tests | O1 speed / latency N/A / N/A input / output No data | O3 Mini speed / latency 117 tok/s / 4809ms input / output No data |
0 tests | O1 speed / latency N/A / N/A input / output No data | O3 Mini speed / latency N/A / N/A input / output No data |
0 tests | O1 speed / latency N/A / N/A input / output No data | O3 Mini speed / latency N/A / N/A input / output No data |
0 tests | O1 speed / latency N/A / N/A input / output No data | O3 Mini speed / latency N/A / N/A input / output No data |
O1 o1-2024-12-17 speed / latency No data input / output $0/request | O3 Mini o3-mini-high speed / latency No data input / output $1.47/request | |
O1 o1-preview-all speed / latency No data input / output $0.041/request | O3 Mini o3-mini speed / latency No data input / output $1.10/M | |
O1 o1-preview-all speed / latency No data input / output $0.033/request | O3 Mini o3-mini-2025-01-31 speed / latency No data input / output $1.10/M |
Weighted outcome: O1. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Output
| Features | Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning | Text inputFile inputText outputTool callingStructured outputsJSON modeReasoning |
|---|
