Top for agents
LMSpeed is an AI model directory for comparing API price, output speed, first-token latency, provider coverage, and benchmark data. Use it to narrow your model and provider choice, then test the endpoint that fits your workload.
Price, speed, latency, and availability can change. Treat this table as a current signal and verify your own endpoint before you deploy.
| Release date | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Context8.2K | Input$30.00/M | Output$60.00/M | Providers |
Agents, Coding, Reasoning, and the other capability columns are 0–100 observed-capability estimates relative to the eligible model population in a dated Category Score V3 run.
They are not success rates, IQ scores, or an average across all eight categories. Read them with the 80% interval, measured dimensions, benchmark families, and evidence shown on each model page.
Each row brings together the information you need to compare an LLM API. Some fields are blank when LMSpeed has no current data for that model or provider.
Start with the decision that matters most for your workload, then compare the current rows before you test an endpoint.
LMSpeed runs standardized five-round API speed tests on each model, measuring output throughput (tokens per second), first-token latency, and total response time across multiple providers.
Latency varies by provider and model. Use the LMSpeed model directory to sort by latency and find the model with the fastest first-token response time. Check the latency leaderboard for monthly rankings.
LMSpeed lists input and output token prices per million for each model across available providers. Sort by price to find a lower-cost option, or filter by provider to compare rates side by side.
— |
49.5±18.4P |
— |
— |
— |
— |
— |
— |
| Throughput 35 t/s | Latency 0.74s |
| Release date2023-05-28 |
|
| GPT-3.5 Turbo InstructOpenAI | Context4.1K | Input— | Output— | Providers +39 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2023-09-28 |
|
| GPT-3.5 TurboOpenAI | Context16.4K | Input$0.500/M | Output$1.50/M | Providers +89 | — | 48.9±18.4P | 33.8±11.8E | — | 37.3±16.0P | — | — | — | Throughput 115 t/s | Latency 2.21s | Release date2024-01-25 |
|
| GPT-3.5 Turbo (older v0613)OpenAI | Context4.1K | Input— | Output— | Providers— | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2024-01-25 |
|
| Claude 3 HaikuAnthropic | Context200K | Input$0.250/M | Output$1.25/M | Providers +15 | 38.2±16.0P | 33.5±13.9P | 35.8±10.8E | 40.4±16.0P | 36.1±11.8E | — | — | 42.1±16.0P | Throughput — | Latency — | Release date2024-03-13 |
|
| GPT-4 TurboOpenAI | Context128K | Input$10.00/M | Output$30.00/M | Providers +67 | — | 44±13.9P | 43.6±11.8E | 54.8±16.0P | 45.7±11.8E | — | — | — | Throughput 50 t/s | Latency 0.97s | Release date2024-04-09 |
|
| WizardLM-2 8x22BMicrosoft | Context65.5K | Input— | Output— | Providers +5 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2024-04-16 |
|
| Mixtral 8x22B InstructMistral | Context65.5K | Input— | Output— | Providers +3 | — | 33.5±13.9P | 36.6±11.1E | — | 36.5±11.8E | — | — | — | Throughput — | Latency — | Release date2024-04-17 |
|
| GPT-4o (2024-05-13)OpenAI | Context128K | Input$5.00/M | Output$15.00/M | Providers | — | 44.1±13.9P | 43.7±11.1E | — | 45.9±11.8E | — | — | — | Throughput — | Latency — | Release date2024-05-13 |
|
| GPT-4o MiniOpenAI | Context128K | Input$0.150/M | Output$0.600/M | Providers +114 | 32.5±16.0P | 38.1±13.9P | 40.5±11.1E | 54.6±16.0P | 46±11.8E | — | — | 40.4±16.0P | Throughput 84 t/s | Latency 4.10s | Release date2024-07-18 |
|
| Mistral NemoMistral | Context131.1K | Input— | Output— | Providers +9 | — | — | — | — | — | — | — | — | Throughput 41 t/s | Latency 2.15s | Release date2024-07-19 |
|
| GPT-4o (2024-08-06)OpenAI | Context128K | Input$2.50/M | Output$10.00/M | Providers | — | 45±13.9P | 40.3±13.9P | — | 46.1±11.8E | — | — | — | Throughput — | Latency — | Release date2024-08-06 |
|
| Hermes 3 Llama 3.1 | Context131.1K | Input— | Output— | Providers +18 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2024-08-18 |
|
| Hermes 3 70B InstructNous | Context131.1K | Input$0.700/M | Output$0.700/M | Providers— | — | 37.3±13.9P | 38.2±11.1E | — | 39.4±11.8E | — | — | — | Throughput — | Latency — | Release date2024-08-18 |
|
| Claude 3.5 HaikuAnthropic | Context200K | Input$0.800/M | Output$4.00/M | Providers +27 | — | 42±13.9P | 39.7±11.1E | — | 42.4±11.8E | — | — | — | Throughput 42 t/s | Latency 2.46s | Release date2024-11-04 |
|
| Mistral Large 2407Mistralai | Context131.1K | Input$2.00/M | Output$6.00/M | Providers | — | 41.1±13.9P | 41.6±11.1E | — | 44.3±11.8E | — | — | — | Throughput — | Latency — | Release date2024-11-19 |
|
| GPT-4oOpenAI | Context128K | Input$2.50/M | Output$10.00/M | Providers +124 | 39.1±16.0P | 46.7±13.9P | 40.5±8.7 | 50±16.0P | 42.1±9.3E | — | — | 41.5±16.0P | Throughput 82 t/s | Latency 3.44s | Release date2024-11-20 |
|
| O1OpenAI | Context200K | Input$15.00/M | Output$60.00/M | Providers +69 | 46±16.0P | 51.3±13.9P | 51±8.7 | 62.5±17.4P | 52.6±9.3E | — | — | 51.7±11.9E | Throughput — | Latency — | Release date2024-12-17 |
|
| Phi 4Microsoft | Context16.4K | Input$0.125/M | Output$0.500/M | Providers +14 | 29±16.0P | 39.8±13.9P | 39.5±8.7 | 38±16.0P | 46.8±11.8E | — | — | 37.5±16.0P | Throughput 43 t/s | Latency 1.32s | Release date2025-01-10 |
|
| MiniMax 01MiniMax | Context1.0M | Input— | Output— | Providers +5 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-01-15 |
|
| R1 Distill Llama 70BDeepSeek | Context128K | Input$0.700/M | Output$1.05/M | Providers | — | 43.3±13.9P | 46±11.1E | — | 55±11.8E | — | — | — | Throughput — | Latency — | Release date2025-01-23 |
|
| SonarPerplexity | Context127.1K | Input— | Output— | Providers +6 | — | 39.1±13.9P | 43.3±11.1E | — | 50.2±11.8E | — | — | — | Throughput — | Latency — | Release date2025-01-27 |
|
| DeepSeek R1 Distill QwenDeepSeek | Context128K | Input— | Output— | Providers +50 | — | 40.9±13.9P | 39.6±8.9 | 55.6±16.0P | 55.7±11.8E | — | — | 37.3±16.0P | Throughput 50 t/s | Latency 19.88s | Release date2025-01-29 |
|
| Aion RP Llama 3.1 | Context32.8K | Input— | Output— | Providers +2 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-02-04 |
|
| O3 MiniOpenAI | Context200K | Input$1.10/M | Output$4.40/M | Providers +79 | 39.9±16.0P | 41±11.2E | 50.1±11.1E | 47.8±17.4P | 58.6±11.8E | — | — | 55.6±16.3P | Throughput 64 t/s | Latency 6.90s | Release date2025-02-12 |
|
| o3 Mini HighOpenAI | Context200K | Input$1.10/M | Output$4.40/M | Providers— | — | 54±13.9P | 51.5±11.1E | — | 61.4±11.8E | — | — | — | Throughput — | Latency — | Release date2025-02-12 |
|
| Mistral SabaMistral | Context32.8K | Input— | Output— | Providers +3 | — | 41±16.0P | 39.5±11.1E | — | 44.5±11.8E | — | — | — | Throughput — | Latency — | Release date2025-02-17 |
|
| Sonar ProPerplexity | Context200K | Input— | Output— | Providers +3 | — | 38.6±13.9P | 46.7±11.1E | — | 47.4±11.8E | — | — | — | Throughput — | Latency — | Release date2025-03-07 |
|
| Sonar Reasoning ProPerplexity | Context128K | Input— | Output— | Providers +3 | — | — | — | — | 57.4±11.8E | — | — | — | Throughput — | Latency — | Release date2025-03-07 |
|
| Reka Flash 3Rekaai | Context65.5K | Input$0.200/M | Output$0.800/M | Providers +1 | — | 43.3±13.9P | 42.6±11.1E | — | 52.2±11.8E | — | — | — | Throughput — | Latency — | Release date2025-03-12 |
|
| GPT-4o SearchOpenAI | Context128K | Input— | Output— | Providers +38 | — | — | — | — | — | — | — | — | Throughput 61 t/s | Latency 3.47s | Release date2025-03-12 |
|
| GPT-4o Mini SearchOpenAI | Context128K | Input— | Output— | Providers +34 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-03-12 |
|
| Command ACohere | Context256K | Input$2.50/M | Output$10.00/M | Providers +8 | 46.4±11.8E | 46.8±13.9P | 46.2±8.7 | 51.7±16.0P | 46.1±11.8E | — | 27.7±11.9E | 54.3±16.0P | Throughput 121 t/s | Latency 0.52s | Release date2025-03-13 |
|
| O1 ProOpenAI | Context200K | Input$150.00/M | Output$600.00/M | Providers +52 | — | — | 52.1±16.0P | 57.7±16.0P | — | — | — | — | Throughput — | Latency — | Release date2025-03-19 |
|
| Llama 4 ScoutMeta | Context10M | Input$0.175/M | Output$0.625/M | Providers +35 | 33.1±11.8E | 35.1±13.9P | 42±8.7 | 39.1±16.0P | 44.3±9.3E | — | — | 43.2±16.0P | Throughput 75 t/s | Latency 1.62s | Release date2025-04-05 |
|
| Llama 4 MaverickMeta | Context1.0M | Input$0.350/M | Output$0.850/M | Providers +14 | 33.4±11.8E | 46.1±13.9P | 47.2±8.7 | 41.9±16.0P | 46.1±9.3E | — | — | 44.3±16.0P | Throughput — | Latency — | Release date2025-04-05 |
|
| GPT-4.1 NanoOpenAI | Context1.0M | Input$0.100/M | Output$0.400/M | Providers +96 | 33.3±11.8E | 41.3±13.9P | 38±8.7 | 33.7±17.4P | 45.1±9.3E | — | — | 37±11.9E | Throughput 140 t/s | Latency 1.78s | Release date2025-04-14 |
|
| GPT-4.1 MiniOpenAI | Context1.0M | Input$0.400/M | Output$1.60/M | Providers +105 | 41.3±11.8E | 39.5±11.2E | 45.8±8.7 | 49.3±17.4P | 49.9±9.3E | — | — | 42.4±11.9E | Throughput 93 t/s | Latency 2.69s | Release date2025-04-14 |
|
| GPT-4.1OpenAI | Context1.0M | Input$2.00/M | Output$8.00/M | Providers +103 | 39.9±11.8E | 38.8±11.2E | 49.3±8.7 | 57±17.4P | 49±9.3E | — | — | 42.1±11.9E | Throughput 85 t/s | Latency 1.92s | Release date2025-04-14 |
|
| O3OpenAI | Context200K | Input$2.00/M | Output$8.00/M | Providers +79 | 49.9±16.0P | 55.9±13.9P | 55±8.7 | 48.8±16.0P | 58.9±9.3E | — | — | 53.4±16.0P | Throughput 134 t/s | Latency 2.82s | Release date2025-04-16 |
|
| O4 MiniOpenAI | Context200K | Input$1.10/M | Output$4.40/M | Providers +82 | — | 59.5±13.9P | 53.7±11.1E | — | 64±11.8E | — | — | — | Throughput 94 t/s | Latency 8.08s | Release date2025-04-16 |
|
| o4 Mini HighOpenAI | Context200K | Input— | Output— | Providers— | — | — | — | — | 51.7±16.1P | — | — | — | Throughput — | Latency — | Release date2025-04-16 |
|
| Qwen3 235B A22BQwen | Context131.1K | Input$0.700/M | Output$8.40/M | Providers | — | 43.8±13.9P | 46.3±11.1E | — | 51±11.8E | — | — | — | Throughput — | Latency — | Release date2025-04-28 |
|
| Qwen3 32BQwen | Context131.1K | Input$0.700/M | Output$8.40/M | Providers | — | 41.9±13.9P | 44.1±11.1E | — | 49.9±11.8E | — | — | — | Throughput — | Latency — | Release date2025-04-28 |
|
| Qwen3 14BQwen | Context131.7K | Input$0.350/M | Output$4.20/M | Providers | — | 41±13.9P | 41.8±11.1E | — | 49.7±11.8E | — | — | — | Throughput — | Latency — | Release date2025-04-28 |
|
| Qwen3 8BQwen | Context131.1K | Input$0.180/M | Output$2.10/M | Providers | — | 33.3±13.9P | 40±11.1E | — | 48.4±11.8E | — | — | — | Throughput — | Latency — | Release date2025-04-28 |
|
| Qwen3 30B A3BQwen | Context131.1K | Input$0.200/M | Output$2.40/M | Providers | — | 41.6±13.9P | 43.5±11.1E | — | 49.3±11.8E | — | — | — | Throughput — | Latency — | Release date2025-04-28 |
|
| Mistral Medium 3Mistral | Context131.1K | Input$0.400/M | Output$2.00/M | Providers +3 | 38.9±16.0P | 46.2±13.9P | 42.5±8.7 | 44.6±16.0P | 52.1±11.8E | — | — | 43.2±16.0P | Throughput — | Latency — | Release date2025-05-07 |
|
| Claude Sonnet 4Anthropic | Context1M | Input$3.00/M | Output$15.00/M | Providers +115 | 44.6±9.3E | 47.1±11.2E | 48.1±8.7 | 50.4±16.0P | 52.9±11.8E | — | — | 45.1±16.0P | Throughput 34 t/s | Latency 4.93s | Release date2025-05-22 |
|
| Claude Opus 4Anthropic | Context200K | Input$15.00/M | Output$75.00/M | Providers +85 | — | 51.7±13.9P | 52±11.1E | — | 54.4±11.8E | — | — | — | Throughput 25 t/s | Latency 12.05s | Release date2025-05-22 |
|
| DeepSeek R1DeepSeek | Context163.8K | Input$1.35/M | Output$4.20/M | Providers +143 | 41.4±16.0P | 50.3±13.9P | 51±8.7 | 45.7±16.0P | 57.1±11.8E | — | — | 43.3±16.0P | Throughput 52 t/s | Latency 10.36s | Release date2025-05-28 |
|
| Gemini 2.5 Pro Preview 06-05Google | Context1.0M | Input$1.25/M | Output$10.00/M | Providers— | — | 54.6±13.9P | 55.8±11.1E | — | 60.8±11.8E | — | — | — | Throughput — | Latency — | Release date2025-06-05 |
|
| O3 ProOpenAI | Context200K | Input$20.00/M | Output$80.00/M | Providers +57 | — | — | 54.7±16.0P | 61.2±16.0P | — | — | — | — | Throughput — | Latency — | Release date2025-06-10 |
|
| Gemini 2.5 ProGoogle | Context1.0M | Input$1.25/M | Output$10.00/M | Providers +159 | 44.2±9.3E | 39.3±8.9 | 55.5±8.7 | 37.5±14.0P | 56.2±9.3E | — | — | 46.1±16.0P | Throughput 88 t/s | Latency 16.94s | Release date2025-06-17 |
|
| Gemini 2.5 FlashGoogle | Context1.0M | Input$0.300/M | Output$2.50/M | Providers +155 | 36.4±16.0P | 51.3±13.9P | 49.6±8.7 | 41.8±16.0P | 50.8±9.3E | — | — | 43.1±16.0P | Throughput 154 t/s | Latency 8.62s | Release date2025-06-17 |
|
| MiniMax M1MiniMax | Context1M | Input$0.550/M | Output$2.20/M | Providers +25 | — | 51.9±13.9P | 49.7±11.1E | — | 59±11.8E | — | — | — | Throughput — | Latency — | Release date2025-06-17 |
|
| Qwen3 | Context262.1K | Input$0.200/M | Output$0.800/M | Providers +120 | — | 46.3±13.9P | 48±11.1E | 36.9±16.3P | 58.4±11.8E | 36.7±16.4P | — | — | Throughput 100 t/s | Latency 12.55s | Release date2025-07-21 |
|
| Qwen3 235B A22B Instruct 2507Qwen | Context262.1K | Input$0.700/M | Output$8.40/M | Providers— | — | 56.1±13.9P | 54±11.1E | — | 63±11.8E | — | — | — | Throughput — | Latency — | Release date2025-07-21 |
|
| Qwen3 CoderQwen | Context1.0M | Input— | Output— | Providers +55 | — | — | — | — | — | — | — | — | Throughput 243 t/s | Latency 5.28s | Release date2025-07-23 |
|
| GLM-4.5 AirZ.ai | Context131.1K | Input$0.170/M | Output$0.980/M | Providers +88 | 43.2±16.0P | 48.8±13.9P | 47.7±8.7 | 36.5±16.0P | 56.9±11.8E | — | — | 42.6±16.0P | Throughput 60 t/s | Latency 10.99s | Release date2025-07-25 |
|
An AI model directory is a searchable list of models and their comparison data. On LMSpeed, it brings together API price, throughput, first-token latency, provider coverage, and capability data when available.
Start with the metric that matters most for your workload. Then open a model page to compare provider data. Run your own speed test before you use an endpoint in production.
Yes. Price, availability, throughput, and latency can change by model, provider, and time. Use current page values as a comparison signal and confirm with your own endpoint test.
