Top for agents
LMSpeed is an AI model directory for comparing API price, output speed, first-token latency, provider coverage, and benchmark data. Use it to narrow your model and provider choice, then test the endpoint that fits your workload.
Price, speed, latency, and availability can change. Treat this table as a current signal and verify your own endpoint before you deploy.
| Release date | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Context131.1K | Input— | Output— | Providers |
Agents, Coding, Reasoning, and the other capability columns are 0–100 observed-capability estimates relative to the eligible model population in a dated Category Score V3 run.
They are not success rates, IQ scores, or an average across all eight categories. Read them with the 80% interval, measured dimensions, benchmark families, and evidence shown on each model page.
Each row brings together the information you need to compare an LLM API. Some fields are blank when LMSpeed has no current data for that model or provider.
Start with the decision that matters most for your workload, then compare the current rows before you test an endpoint.
LMSpeed runs standardized five-round API speed tests on each model, measuring output throughput (tokens per second), first-token latency, and total response time across multiple providers.
Latency varies by provider and model. Use the LMSpeed model directory to sort by latency and find the model with the fastest first-token response time. Check the latency leaderboard for monthly rankings.
LMSpeed lists input and output token prices per million for each model across available providers. Sort by price to find a lower-cost option, or filter by provider to compare rates side by side.
— |
51.7±13.9P |
53.1±11.1E |
— |
60.6±11.8E |
— |
— |
— |
| Throughput 39 t/s | Latency 7.22s |
| Release date2025-07-25 |
|
| Qwen3 Coder 30B A3B InstructQwen | Context160K | Input$0.450/M | Output$2.25/M | Providers | — | 43.5±13.9P | 43.1±11.1E | — | 50.5±11.8E | — | — | — | Throughput — | Latency — | Release date2025-07-31 |
|
| Claude Opus 4.1Anthropic | Context200K | Input$15.00/M | Output$75.00/M | Providers +96 | 47.1±16.2P | 47.9±16.1P | — | 60.1±16.0P | — | — | — | — | Throughput 22 t/s | Latency 3.56s | Release date2025-08-05 |
|
| gpt-oss-20bOpenAI | Context131.1K | Input$0.060/M | Output$0.200/M | Providers | 38±9.3E | 48.4±11.2E | 44.6±8.7 | 36.1±16.0P | 52.9±16.1P | — | — | 51.2±16.0P | Throughput — | Latency — | Release date2025-08-05 |
|
| GPT-OSS | Context131.1K | Input— | Output— | Providers +127 | — | — | — | — | — | — | — | — | Throughput 390 t/s | Latency 2.28s | Release date2025-08-05 |
|
| gpt-oss-120bOpenAI | Context131.1K | Input$0.150/M | Output$0.600/M | Providers +2 | 36.9±6.2 | 50.8±11.2E | 50.3±8.7 | 43.6±14.0P | 53.7±16.1P | 31.5±17.3P | — | 52.5±16.0P | Throughput — | Latency — | Release date2025-08-05 |
|
| GPT-5 NanoOpenAI | Context400K | Input$0.050/M | Output$0.400/M | Providers +103 | — | 51.7±13.9P | 48.2±11.1E | — | 50.9±16.1P | — | — | — | Throughput 123 t/s | Latency 10.60s | Release date2025-08-07 |
|
| GPT-5 MiniOpenAI | Context400K | Input$0.250/M | Output$2.00/M | Providers +104 | — | 49.8±11.2E | 53.4±11.1E | — | 52.2±16.1P | — | — | — | Throughput 90 t/s | Latency 7.03s | Release date2025-08-07 |
|
| GPT-5OpenAI | Context400K | Input$1.25/M | Output$10.00/M | Providers +146 | 45.9±9.3E | 49.3±11.2E | 51.9±8.7 | 50.1±16.0P | 61.5±11.8E | — | — | 53.1±16.0P | Throughput 88 t/s | Latency 6.23s | Release date2025-08-07 |
|
| GLM-4.5VZ.ai | Context65.5K | Input$0.600/M | Output$1.80/M | Providers +33 | — | 42.8±13.9P | 48.5±11.1E | — | 50±16.1P | — | — | — | Throughput 73 t/s | Latency 6.15s | Release date2025-08-11 |
|
| Mistral Medium 3.1Mistral | Context131.1K | Input$0.400/M | Output$2.00/M | Providers +2 | — | 46.6±13.9P | 43.3±11.1E | — | 43.6±16.1P | — | — | — | Throughput — | Latency — | Release date2025-08-13 |
|
| DeepSeek Chat V3.1DeepSeek | Context163.8K | Input— | Output— | Providers +6 | — | — | — | — | — | — | — | — | Throughput 23 t/s | Latency 2.02s | Release date2025-08-21 |
|
| Kimi K2MoonshotAI | Context131.1K | Input$0.585/M | Output$2.40/M | Providers +82 | 45.7±16.0P | 48.9±13.9P | 49.3±8.7 | 45.6±16.0P | 53.7±9.3E | — | — | 43.9±16.0P | Throughput 29 t/s | Latency 2.21s | Release date2025-09-04 |
|
| Kimi K2 0905MoonshotAI | Context262.1K | Input$0.600/M | Output$2.50/M | Providers— | — | 47.8±13.9P | 50.9±11.1E | — | 47.1±16.1P | — | — | — | Throughput — | Latency — | Release date2025-09-04 |
|
| Qwen3 Next 80B A3B InstructQwen | Context262.1K | Input$0.500/M | Output$2.00/M | Providers +17 | — | 48.8±13.9P | 50.8±11.1E | — | 48.7±16.1P | — | — | — | Throughput — | Latency — | Release date2025-09-11 |
|
| DeepSeek V3.1 TerminusDeepSeek | Context131.1K | Input$0.270/M | Output$1.00/M | Providers +83 | — | 55.5±13.9P | 54.5±11.1E | — | 53±16.1P | — | — | — | Throughput 58 t/s | Latency 1.50s | Release date2025-09-22 |
|
| GPT-5 CodexOpenAI | Context400K | Input$1.25/M | Output$10.00/M | Providers +121 | — | 56.6±13.9P | 57.1±11.1E | — | 54.7±16.1P | — | — | — | Throughput 154 t/s | Latency 2.76s | Release date2025-09-23 |
|
| Qwen3 Coder PlusQwen | Context1M | Input— | Output— | Providers +68 | — | — | — | — | — | — | — | — | Throughput 45 t/s | Latency 1.35s | Release date2025-09-23 |
|
| Qwen3 MaxQwen | Context262.1K | Input$1.20/M | Output$6.00/M | Providers +87 | 47.7±11.8E | 45.3±11.2E | 49.6±8.7 | 41.5±16.0P | 51.4±16.1P | — | — | 44.7±16.0P | Throughput 38 t/s | Latency 7.37s | Release date2025-09-23 |
|
| Qwen3 VL 235B A22B InstructQwen | Context131.1K | Input$0.700/M | Output$2.80/M | Providers +5 | — | 50.1±13.9P | 50.4±11.1E | — | 49.5±16.1P | — | — | — | Throughput — | Latency — | Release date2025-09-23 |
|
| Gemini 2.5 Flash LiteGoogle | Context1.0M | Input$0.100/M | Output$0.400/M | Providers +112 | — | 37.1±13.9P | 43.2±11.1E | — | 53.3±11.8E | — | — | — | Throughput 277 t/s | Latency 1.41s | Release date2025-09-25 |
|
| DeepSeek V3.2 ExpDeepSeek | Context163.8K | Input$0.280/M | Output$0.420/M | Providers | — | 54±13.9P | 54.3±11.1E | — | 52.7±16.1P | — | — | — | Throughput — | Latency — | Release date2025-09-29 |
|
| Claude Sonnet 4.5Anthropic | Context1M | Input$3.00/M | Output$15.00/M | Providers +163 | 47.6±8.8 | 52.6±11.2E | 45.6±9.0E | 53±16.1P | 42.5±12.3E | — | — | — | Throughput 41 t/s | Latency 4.57s | Release date2025-09-29 |
|
| GLM-4.6Z.ai | Context202.8K | Input$0.550/M | Output$2.20/M | Providers +94 | 48.9±16.0P | 42.2±11.2E | 43.3±8.7 | 44.5±16.0P | 44.8±16.1P | — | — | 42.3±16.0P | Throughput 53 t/s | Latency 16.68s | Release date2025-09-30 |
|
| GPT-5 ProOpenAI | Context400K | Input— | Output— | Providers +66 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-06 |
|
| Qwen3 VL 30B A3B InstructQwen | Context262.1K | Input$0.200/M | Output$0.800/M | Providers +1 | — | 46±13.9P | 47.8±11.1E | — | 49.8±16.1P | — | — | — | Throughput — | Latency — | Release date2025-10-06 |
|
| Gemini 2.5 Flash ImageGoogle | Context32.8K | Input— | Output— | Providers +85 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-07 |
|
| O4 Mini Deep ResearchOpenAI | Context200K | Input— | Output— | Providers +27 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-10 |
|
| O3 Deep ResearchOpenAI | Context200K | Input— | Output— | Providers +29 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-10 |
|
| GPT-5 ImageOpenAI | Context400K | Input— | Output— | Providers +4 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-14 |
|
| Qwen3 VL 8B InstructQwen | Context256K | Input$0.180/M | Output$0.700/M | Providers +2 | — | 35.9±13.9P | 41.1±11.1E | — | 41.5±16.1P | — | — | — | Throughput — | Latency — | Release date2025-10-14 |
|
| Claude Haiku 4.5Anthropic | Context200K | Input$1.00/M | Output$5.00/M | Providers +184 | 43±16.2P | 47.2±11.2E | 47.9±11.1E | — | 45.7±16.1P | — | — | — | Throughput 102 t/s | Latency 2.77s | Release date2025-10-15 |
|
| GPT-5 Image MiniOpenAI | Context400K | Input— | Output— | Providers +3 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-16 |
|
| Phi 4 Mini Instruct | Context131.1K | Input— | Output— | Providers +27 | — | 28.3±13.9P | 34.7±11.1E | — | 41.8±11.8E | — | — | — | Throughput — | Latency — | Release date2025-10-17 |
|
| Granite 4.0 H MicroIBM | Context131K | Input— | Output— | Providers +5 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-20 |
|
| Qwen3 VL 32B InstructQwen | Context262.1K | Input$0.700/M | Output$2.80/M | Providers +2 | — | 46.2±13.9P | 48.6±11.1E | — | 49.1±16.1P | — | — | — | Throughput — | Latency — | Release date2025-10-23 |
|
| MiniMax M2MiniMax | Context204.8K | Input$0.300/M | Output$1.20/M | Providers +74 | — | 54±13.9P | 52.4±11.1E | — | 50.9±16.1P | — | — | — | Throughput 48 t/s | Latency 10.12s | Release date2025-10-23 |
|
| Text Embedding 3 SmallOpenAI | Context8.2K | Input— | Output— | Providers +52 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-30 |
|
| Text Embedding 3 LargeOpenAI | Context8.2K | Input— | Output— | Providers +52 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-30 |
|
| Gemini Embedding 001Google | Context20K | Input— | Output— | Providers +56 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-31 |
|
| Nova Premier V1Amazon | Context1M | Input— | Output— | Providers +3 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-10-31 |
|
| Kimi K2 ThinkingMoonshotAI | Context262.1K | Input$0.600/M | Output$2.50/M | Providers +97 | — | 57.6±13.9P | 55.9±11.1E | — | 53.9±16.1P | — | — | — | Throughput 51 t/s | Latency 16.73s | Release date2025-11-06 |
|
| GPT-5.1 Codex MiniOpenAI | Context400K | Input$0.250/M | Output$2.00/M | Providers +119 | — | 57.2±13.9P | 53.5±11.1E | — | 53.4±16.1P | — | — | — | Throughput 136 t/s | Latency 4.28s | Release date2025-11-13 |
|
| GPT-5.1 CodexOpenAI | Context400K | Input$1.25/M | Output$10.00/M | Providers +128 | 50.1±9.3E | 50.8±11.2E | 56.3±8.7 | 51.2±16.0P | 54.1±16.1P | — | — | 52.9±16.0P | Throughput — | Latency — | Release date2025-11-13 |
|
| GPT-5.1OpenAI | Context400K | Input$1.25/M | Output$10.00/M | Providers +147 | 48.2±9.3E | 49.4±11.2E | 52.8±8.7 | 54.2±16.0P | 54±16.1P | — | — | 53.9±16.0P | Throughput 142 t/s | Latency 2.78s | Release date2025-11-13 |
|
| BGE Large EN V1.5BAAI | Context8.2K | Input— | Output— | Providers +18 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-11-18 |
|
| Olmo 3 32B ThinkAllenAI | Context65.5K | Input— | Output— | Providers | — | 47.6±13.9P | 46.6±11.1E | — | 50.1±16.1P | — | — | — | Throughput — | Latency — | Release date2025-11-21 |
|
| Claude Opus 4.5Anthropic | Context200K | Input$5.00/M | Output$25.00/M | Providers +154 | 50.2±5.3 | 57.8±8.1 | 62.7±8.1 | 57.6±11.6E | 49.8±9.1E | 52±12.2E | 31.1±6.5 | 45.7±11.9E | Throughput 54 t/s | Latency 3.12s | Release date2025-11-24 |
|
| DeepSeek V3.2DeepSeek | Context163.8K | Input$0.280/M | Output$0.420/M | Providers +170 | 39.5±6.9 | 51.6±8.6 | 51.4±8.7 | 40.6±16.0P | 49±16.1P | — | — | 46.2±16.0P | Throughput 46 t/s | Latency 5.36s | Release date2025-12-01 |
|
| Mistral LargeMistralai | Context128K | Input$4.00/M | Output$12.00/M | Providers +18 | — | 35.6±13.9P | 35.8±11.1E | — | 36.3±11.8E | — | — | — | Throughput — | Latency — | Release date2025-12-01 |
|
| GPT-5.1 Codex MaxOpenAI | Context400K | Input— | Output— | Providers +120 | 50.5±16.0P | 51.1±11.8E | 55.9±10.8E | 51.2±16.0P | — | — | — | 52.9±16.0P | Throughput 56 t/s | Latency 6.29s | Release date2025-12-04 |
|
| GLM-4.6VZ.ai | Context131.1K | Input$0.300/M | Output$0.900/M | Providers +53 | — | 40.7±13.9P | 50.1±11.1E | — | 52.2±16.1P | — | — | — | Throughput 40 t/s | Latency 27.37s | Release date2025-12-08 |
|
| GPT-5.2 ProOpenAI | Context400K | Input— | Output— | Providers +83 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-12-10 |
|
| GPT-5.2OpenAI | Context400K | Input$1.75/M | Output$14.00/M | Providers +233 | 48.7±6.6 | 57±8.5 | 54.9±6.5 | 56.2±14.0P | 55.9±16.1P | — | 42.8±9.0E | 54.9±16.0P | Throughput 56 t/s | Latency 3.43s | Release date2025-12-10 |
|
| MiMo-V2-Flash | Context262.1K | Input$0.100/M | Output$0.300/M | Providers +49 | 48.1±11.8E | 51.5±11.2E | 48.6±8.7 | 40.1±16.0P | 51.1±17.4P | — | — | 43.4±16.0P | Throughput 107 t/s | Latency 3.20s | Release date2025-12-14 |
|
| FLUX.2 MaxBlack Forest Labs | Context46.9K | Input— | Output— | Providers +8 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-12-16 |
|
| Gemini 3 FlashGoogle | Context1.0M | Input$0.500/M | Output$3.00/M | Providers +171 | 43.1±8.9 | 53.9±11.2E | 52.5±8.7 | 51.8±16.0P | 51.9±16.1P | — | — | 48±16.0P | Throughput 144 t/s | Latency 8.01s | Release date2025-12-17 |
|
| Gemini 3 Flash PreviewGoogle | Context1.0M | Input$0.500/M | Output$3.00/M | Providers +2 | — | 62.9±13.9P | 60.7±11.1E | — | 54.4±16.1P | — | — | — | Throughput — | Latency — | Release date2025-12-17 |
|
| GLM-4.7Z.ai | Context202.8K | Input$0.600/M | Output$2.20/M | Providers +140 | 47.8±8.6 | 53.8±10.5E | 55±8.7 | 37±14.0P | 48.8±12.3E | — | — | 52.1±16.0P | Throughput 94 t/s | Latency 18.83s | Release date2025-12-22 |
|
| MiniMax M2.1MiniMax | Context204.8K | Input$0.300/M | Output$1.20/M | Providers +99 | — | 55.8±13.9P | 57.3±11.1E | — | 51.7±16.1P | — | — | — | Throughput 74 t/s | Latency 4.19s | Release date2025-12-23 |
|
An AI model directory is a searchable list of models and their comparison data. On LMSpeed, it brings together API price, throughput, first-token latency, provider coverage, and capability data when available.
Start with the metric that matters most for your workload. Then open a model page to compare provider data. Run your own speed test before you use an endpoint in production.
Yes. Price, availability, throughput, and latency can change by model, provider, and time. Use current page values as a comparison signal and confirm with your own endpoint test.
