AI Model Benchmark Directory

LMSpeed is an AI model directory for comparing API price, output speed, first-token latency, provider coverage, and benchmark data. Use it to narrow your model and provider choice, then test the endpoint that fits your workload.

Price, speed, latency, and availability can change. Treat this table as a current signal and verify your own endpoint before you deploy.

Newest Most tested Recently tested A–Z

Model	Context	Input	Output	Providers	Agents	Coding	Reasoning	Knowledge	Math	Multilingual	Multimodal	Instruction following	Throughput	Latency	Release date
GPT-OSS	Context131.1K	Input—	Output—	Providers +137	—	—	—	—	—	—	—	—	Throughput 374 t/s	Latency 3.23s	Release date2025-08-05	— — — — — — — —
GPT-4oOpenAI	Context128K	Input$2.50/M	Output$10.00/M	Providers +133	39±16.0P	46±13.9P	39.9±8.7	48.9±16.0P	42.2±9.3E	—	—	41.6±16.0P	Throughput 82 t/s	Latency 3.44s	Release date2024-11-20	39 46 39.9 48.9 42.2 — — 41.6
GPT-5.4 MiniOpenAI	Context400K	Input$0.750/M	Output$4.50/M	Providers +240	50.9±8.1	57.2±11.8E	55.5±10.8E	46.1±14.0P	49.7±16.1P	—	47.1±16.1P	53.6±16.0P	Throughput 134 t/s	Latency 3.54s	Release date2026-03-17	50.9 57.2 55.5 46.1 49.7 — 47.1 53.6
GPT-4o MiniOpenAI	Context128K	Input$0.150/M	Output$0.600/M	Providers +121	32±16.0P	37.5±13.9P	40.2±11.1E	53.2±16.0P	46.1±11.8E	—	—	40.5±16.0P	Throughput 84 t/s	Latency 4.10s	Release date2024-07-18	32 37.5 40.2 53.2 46.1 — — 40.5
GPT-5.1OpenAI	Context400K	Input$1.25/M	Output$10.00/M	Providers +153	47.7±9.3E	49.1±11.2E	53.9±8.7	52.9±16.0P	54±16.1P	—	—	53.5±16.0P	Throughput 142 t/s	Latency 2.78s	Release date2025-11-13	47.7 49.1 53.9 52.9 54 — — 53.5
GPT-4.1OpenAI	Context1.0M	Input$2.00/M	Output$8.00/M	Providers +109	40±11.8E	38.1±11.2E	48.5±8.7	57±17.4P	49±9.3E	—	—	42.1±11.9E	Throughput 85 t/s	Latency 1.92s	Release date2025-04-14	40 38.1 48.5 57 49 — — 42.1
GPT-5 MiniOpenAI	Context400K	Input$0.250/M	Output$2.00/M	Providers +111	—	49.4±11.2E	53.5±11.1E	—	52.2±16.1P	—	—	—	Throughput 90 t/s	Latency 7.03s	Release date2025-08-07	— 49.4 53.5 — 52.2 — — —
GPT-5.1 Codex MaxOpenAI	Context400K	Input—	Output—	Providers +126	49.9±16.0P	50.7±11.8E	54.2±10.8E	49.9±16.0P	—	—	—	52.5±16.0P	Throughput 56 t/s	Latency 6.29s	Release date2025-12-04	49.9 50.7 54.2 49.9 — — — 52.5
GPT-4.1 MiniOpenAI	Context1.0M	Input$0.400/M	Output$1.60/M	Providers +112	40.7±11.8E	38.8±11.2E	45.3±8.7	49.3±17.4P	49.9±9.3E	—	—	42.4±11.9E	Throughput 93 t/s	Latency 2.69s	Release date2025-04-14	40.7 38.8 45.3 49.3 49.9 — — 42.4
GPT-5.4OpenAI	Context1.1M	Input$2.50/M	Output$15.00/M	Providers +294	57±5.1	62.1±10.3E	55.9±8.7	59.9±15.1P	57.6±16.1P	—	52.9±6.6	53.9±16.0P	Throughput 49 t/s	Latency 4.45s	Release date2026-03-05	57 62.1 55.9 59.9 57.6 — 52.9 53.9
GPT Audio MiniOpenAI	Context128K	Input—	Output—	Providers +16	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2026-01-19	— — — — — — — —
GPT-3.5 Turbo InstructOpenAI	Context4.1K	Input—	Output—	Providers +44	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2023-09-28	— — — — — — — —
GPT-3.5 TurboOpenAI	Context16.4K	Input$0.500/M	Output$1.50/M	Providers +98	—	48.8±18.4P	33.3±11.8E	—	37.8±16.0P	—	—	—	Throughput 115 t/s	Latency 2.21s	Release date2024-01-25	— 48.8 33.3 — 37.8 — — —
GPT-4 TurboOpenAI	Context128K	Input$10.00/M	Output$30.00/M	Providers +73	—	43.3±13.9P	43.2±11.8E	53.5±16.0P	45.8±11.8E	—	—	—	Throughput 50 t/s	Latency 0.97s	Release date2024-04-09	— 43.3 43.2 53.5 45.8 — — —
GPT-5.1 Codex MiniOpenAI	Context400K	Input$0.250/M	Output$2.00/M	Providers +125	—	56.4±13.9P	53.1±11.1E	—	53.4±16.1P	—	—	—	Throughput 136 t/s	Latency 4.28s	Release date2025-11-13	— 56.4 53.1 — 53.4 — — —
GPT-4.5OpenAI	Context—	Input—	Output—	Providers +40	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-SoVITS	Context—	Input—	Output—	Providers +1	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4 VisionOpenAI	Context—	Input—	Output—	Providers +33	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4.1 NanoOpenAI	Context1.0M	Input$0.100/M	Output$0.400/M	Providers +103	32.8±11.8E	40.8±13.9P	37.6±8.7	33.7±17.4P	45.2±9.3E	—	—	37.1±11.9E	Throughput 140 t/s	Latency 1.78s	Release date2025-04-14	32.8 40.8 37.6 33.7 45.2 — — 37.1
GPT-4o SearchOpenAI	Context128K	Input—	Output—	Providers +39	—	—	—	—	—	—	—	—	Throughput 61 t/s	Latency 3.47s	Release date2025-03-12	— — — — — — — —
GPT-4o Mini TTSOpenAI	Context—	Input—	Output—	Providers +43	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5OpenAI	Context400K	Input$1.25/M	Output$10.00/M	Providers +153	45±9.3E	48.9±11.2E	52.6±8.7	49.3±16.0P	61.4±11.8E	—	—	53.6±16.0P	Throughput 88 t/s	Latency 6.23s	Release date2025-08-07	45 48.9 52.6 49.3 61.4 — — 53.6
GPT-5.2 CodexOpenAI	Context400K	Input$1.75/M	Output$14.00/M	Providers +156	51.2±9.3E	57.5±11.8E	58.6±10.8E	51±16.0P	—	—	—	55.3±16.0P	Throughput 54 t/s	Latency 3.51s	Release date2026-01-14	51.2 57.5 58.6 51 — — — 55.3
ChatGPT-4oOpenAI	Context—	Input—	Output—	Providers +49	—	—	—	—	—	—	—	—	Throughput 78 t/s	Latency 4.56s	Release date—	— — — — — — — —
GPT-4o Mini TranscribeOpenAI	Context128K	Input—	Output—	Providers +38	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2026-05-01	— — — — — — — —
Net GPT-4o	Context—	Input—	Output—	Providers	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4 GizmoOpenAI	Context—	Input—	Output—	Providers +24	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT Image 1.5OpenAI	Context—	Input—	Output—	Providers +115	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4 NetOpenAI	Context—	Input—	Output—	Providers +2	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5.2 ProOpenAI	Context400K	Input—	Output—	Providers +90	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2025-12-10	— — — — — — — —
GPT-5.1 CodexOpenAI	Context400K	Input$1.25/M	Output$10.00/M	Providers +133	49.7±9.3E	50.5±11.2E	55.2±8.7	49.9±16.0P	54.1±16.1P	—	—	52.5±16.0P	Throughput —	Latency —	Release date2025-11-13	49.7 50.5 55.2 49.9 54.1 — — 52.5
GPT-4o ImageOpenAI	Context—	Input—	Output—	Providers +29	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5 Codex MiniOpenAI	Context—	Input—	Output—	Providers +64	—	—	—	—	—	—	—	—	Throughput 38 t/s	Latency 3.35s	Release date—	— — — — — — — —
ChatGPT Image	Context—	Input—	Output—	Providers +17	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4o Transcribe DiarizeOpenAI	Context—	Input—	Output—	Providers +18	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5.4 NanoOpenAI	Context400K	Input$0.200/M	Output$1.25/M	Providers +97	44.7±8.1	49.6±11.8E	49.8±10.8E	42.6±14.0P	51.8±16.1P	—	31.2±16.1P	54.6±16.0P	Throughput 137 t/s	Latency 3.38s	Release date2026-03-17	44.7 49.6 49.8 42.6 51.8 — 31.2 54.6
GPT-5.3 CodexOpenAI	Context400K	Input$1.75/M	Output$14.00/M	Providers +253	52.6±6.6	58±8.5	59.5±10.8E	54.3±16.0P	—	—	—	54.4±16.0P	Throughput 78 t/s	Latency 3.91s	Release date2026-02-24	52.6 58 59.5 54.3 — — — 54.4
GPT-5.2OpenAI	Context400K	Input$1.75/M	Output$14.00/M	Providers +241	47.5±6.6	56±8.5	53.3±6.4	57.2±14.0P	55.9±16.1P	—	42.3±9.0E	54.4±16.0P	Throughput 56 t/s	Latency 3.43s	Release date2025-12-10	47.5 56 53.3 57.2 55.9 — 42.3 54.4
GPT-4o RealtimeOpenAI	Context—	Input—	Output—	Providers +73	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5 NanoOpenAI	Context400K	Input$0.050/M	Output$0.400/M	Providers +111	—	51±13.9P	47.9±11.1E	—	50.9±16.1P	—	—	—	Throughput 123 t/s	Latency 10.60s	Release date2025-08-07	— 51 47.9 — 50.9 — — —
GPT-4o Mini RealtimeOpenAI	Context—	Input—	Output—	Providers +36	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5 CodexOpenAI	Context400K	Input$1.25/M	Output$10.00/M	Providers +124	—	55.8±13.9P	56.6±11.1E	—	54.7±16.1P	—	—	—	Throughput 154 t/s	Latency 2.76s	Release date2025-09-23	— 55.8 56.6 — 54.7 — — —
GPT-4o Mini AudioOpenAI	Context—	Input—	Output—	Providers +34	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT AudioOpenAI	Context128K	Input—	Output—	Providers +22	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2026-01-19	— — — — — — — —
GPT-4o AudioOpenAI	Context—	Input—	Output—	Providers +80	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4 DALL-EOpenAI	Context—	Input—	Output—	Providers +12	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5 ProOpenAI	Context400K	Input—	Output—	Providers +72	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2025-10-06	— — — — — — — —
GPT Image 1OpenAI	Context400K	Input—	Output—	Providers +44	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2026-06-24	— — — — — — — —
GPT-5.3OpenAI	Context128K	Input—	Output—	Providers +75	—	—	—	—	—	—	—	—	Throughput 59 t/s	Latency 2.57s	Release date2026-03-03	— — — — — — — —
GPT-4OpenAI	Context8.2K	Input$30.00/M	Output$60.00/M	Providers +77	—	49.5±18.4P	36.9±11.8E	—	40.7±16.0P	—	—	—	Throughput 35 t/s	Latency 0.74s	Release date2023-05-28	— 49.5 36.9 — 40.7 — — —
GPT-4o Mini SearchOpenAI	Context128K	Input—	Output—	Providers +36	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2025-03-12	— — — — — — — —
GPT-5.4 ProOpenAI	Context1.1M	Input$30.00/M	Output$180.00/M	Providers +71	60.2±16.1P	—	58.6±11.2E	60.8±16.1P	56.8±16.1P	—	73±16.1P	—	Throughput —	Latency —	Release date2026-03-05	60.2 — 58.6 60.8 56.8 — 73 —
GPT Image 1 MiniOpenAI	Context400K	Input—	Output—	Providers +20	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2026-06-24	— — — — — — — —
GPT-3.5 NetOpenAI	Context—	Input—	Output—	Providers +1	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-4o TranscribeOpenAI	Context128K	Input—	Output—	Providers +40	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2026-04-27	— — — — — — — —
GPT-4o DALL-EOpenAI	Context—	Input—	Output—	Providers	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT-5 ImageOpenAI	Context400K	Input—	Output—	Providers +7	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date2025-10-14	— — — — — — — —
GPT-4o StudyOpenAI	Context—	Input—	Output—	Providers +4	—	—	—	—	—	—	—	—	Throughput —	Latency —	Release date—	— — — — — — — —
GPT Image 2OpenAI	Context400K	Input—	Output—	Providers +118	—	—	—	—	—	—	—	—	Throughput 51 t/s	Latency 3.62s	Release date2026-06-24	— — — — — — — —
GPT-5.5OpenAI	Context1.1M	Input$5.00/M	Output$30.00/M	Providers +152	61.7±5.1	59.4±8.7	58.9±8.7	58.9±14.0P	56.9±16.1P	—	55.7±16.1P	54.6±16.0P	Throughput 46 t/s	Latency 4.95s	Release date2026-04-24	61.7 59.4 58.9 58.9 56.9 — 55.7 54.6

How to read category scores

Agents, Coding, Reasoning, and the other capability columns are 0–100 observed-capability estimates relative to the eligible model population in a dated Category Score V3 run.

They are not success rates, IQ scores, or an average across all eight categories. Read them with the 80% interval, measured dimensions, benchmark families, and evidence shown on each model page.

Read the complete scoring methodology

What this directory shows

Each row brings together the information you need to compare an LLM API. Some fields are blank when LMSpeed has no current data for that model or provider.

API price: Compare input and output price per million tokens when it is available.
Speed and latency: Use throughput and first-token latency to compare response behavior.
Provider coverage: Open a model to review its listed providers and their current details.
Capability data: Use the capability columns when current model scores are available.

How to use the model directory

Start with the decision that matters most for your workload, then compare the current rows before you test an endpoint.

Find a model.Search by model name, slug, or description.
Sort the key metric.Sort by price, throughput, latency, provider count, or capability data.
Compare providers.Open a model page to review the provider options and current data.
Test your endpoint.Run a speed test before you use an endpoint in production.

Model pricing leaderboard Model speed leaderboard Latency leaderboard Provider directory LLM API speed test

Frequently Asked Questions

How does LMSpeed benchmark AI models?

LMSpeed runs standardized five-round API speed tests on each model, measuring output throughput (tokens per second), first-token latency, and total response time across multiple providers.

Which AI model has the lowest API latency?

Latency varies by provider and model. Use the LMSpeed model directory to sort by latency and find the model with the fastest first-token response time. Check the latency leaderboard for monthly rankings.

How to compare LLM API pricing across providers?

LMSpeed lists input and output token prices per million for each model across available providers. Sort by price to find a lower-cost option, or filter by provider to compare rates side by side.

What is an AI model directory?

An AI model directory is a searchable list of models and their comparison data. On LMSpeed, it brings together API price, throughput, first-token latency, provider coverage, and capability data when available.

How do I choose a model and provider?

Start with the metric that matters most for your workload. Then open a model page to compare provider data. Run your own speed test before you use an endpoint in production.

Can model price and speed change?

Yes. Price, availability, throughput, and latency can change by model, provider, and time. Use current page values as a comparison signal and confirm with your own endpoint test.