Top for agents
LMSpeed is an AI model directory for comparing API price, output speed, first-token latency, provider coverage, and benchmark data. Use it to narrow your model and provider choice, then test the endpoint that fits your workload.
Price, speed, latency, and availability can change. Treat this table as a current signal and verify your own endpoint before you deploy.
| Release date | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Context204.8K | Input$0.300/M | Output$1.20/M | Providers |
Agents, Coding, Reasoning, and the other capability columns are 0–100 observed-capability estimates relative to the eligible model population in a dated Category Score V3 run.
They are not success rates, IQ scores, or an average across all eight categories. Read them with the 80% interval, measured dimensions, benchmark families, and evidence shown on each model page.
Each row brings together the information you need to compare an LLM API. Some fields are blank when LMSpeed has no current data for that model or provider.
Start with the decision that matters most for your workload, then compare the current rows before you test an endpoint.
LMSpeed runs standardized five-round API speed tests on each model, measuring output throughput (tokens per second), first-token latency, and total response time across multiple providers.
Latency varies by provider and model. Use the LMSpeed model directory to sort by latency and find the model with the fastest first-token response time. Check the latency leaderboard for monthly rankings.
LMSpeed lists input and output token prices per million for each model across available providers. Sort by price to find a lower-cost option, or filter by provider to compare rates side by side.
45.6±6.0 |
47.7±8.2 |
54.8±10.8E |
52.9±16.0P |
— |
— |
— |
55±16.0P |
| Throughput 178 t/s | Latency 7.32s |
| Release date2026-03-18 |
|
| MiniMax M2.5MiniMax | Context204.8K | Input$0.300/M | Output$1.20/M | Providers +175 | — | 50.4±11.8E | 55.5±13.9P | — | — | — | — | — | Throughput 57 t/s | Latency 9.85s | Release date2026-02-12 |
|
| GLM-5Z.ai | Context202.8K | Input$1.00/M | Output$3.20/M | Providers +172 | 42.8±5.6 | 52.3±8.1 | 49.5±8.1 | 43.3±16.3P | 51.1±9.1E | 44±12.2E | — | 52.6±11.9E | Throughput 46 t/s | Latency 22.00s | Release date2026-02-11 |
|
| Gemini 3 FlashGoogle | Context1.0M | Input$0.500/M | Output$3.00/M | Providers +171 | 43.1±8.9 | 53.9±11.2E | 52.5±8.7 | 51.8±16.0P | 51.9±16.1P | — | — | 48±16.0P | Throughput 144 t/s | Latency 8.01s | Release date2025-12-17 |
|
| DeepSeek R1DeepSeek | Context163.8K | Input$1.35/M | Output$4.20/M | Providers +143 | 41.4±16.0P | 50.3±13.9P | 51±8.7 | 45.7±16.0P | 57.1±11.8E | — | — | 43.3±16.0P | Throughput 52 t/s | Latency 10.36s | Release date2025-05-28 |
|
| Llama 4 MaverickMeta | Context1.0M | Input$0.350/M | Output$0.850/M | Providers +14 | 33.4±11.8E | 46.1±13.9P | 47.2±8.7 | 41.9±16.0P | 46.1±9.3E | — | — | 44.3±16.0P | Throughput — | Latency — | Release date2025-04-05 |
|
| Llama 4 ScoutMeta | Context10M | Input$0.175/M | Output$0.625/M | Providers +35 | 33.1±11.8E | 35.1±13.9P | 42±8.7 | 39.1±16.0P | 44.3±9.3E | — | — | 43.2±16.0P | Throughput 75 t/s | Latency 1.62s | Release date2025-04-05 |
|
| Aion RP Llama 3.1 | Context32.8K | Input— | Output— | Providers +2 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2025-02-04 |
|
| R1 Distill Llama 70BDeepSeek | Context128K | Input$0.700/M | Output$1.05/M | Providers | — | 43.3±13.9P | 46±11.1E | — | 55±11.8E | — | — | — | Throughput — | Latency — | Release date2025-01-23 |
|
| Hermes 3 70B InstructNous | Context131.1K | Input$0.700/M | Output$0.700/M | Providers— | — | 37.3±13.9P | 38.2±11.1E | — | 39.4±11.8E | — | — | — | Throughput — | Latency — | Release date2024-08-18 |
|
| Hermes 3 Llama 3.1 | Context131.1K | Input— | Output— | Providers +18 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date2024-08-18 |
|
| Llama 3.1Meta | Context— | Input— | Output— | Providers +22 | 37.6±16.0P | 45.8±16.0P | 38±10.8E | 48.3±16.0P | — | — | — | 43.1±16.0P | Throughput — | Latency — | Release date— |
|
| Llama 3.3Meta | Context— | Input— | Output— | Providers +12 | — | — | — | — | — | — | — | — | Throughput 985 t/s | Latency 0.45s | Release date— |
|
| Meta Llama 3.3 Instruct | Context— | Input— | Output— | Providers | — | — | — | — | — | — | — | — | Throughput 48 t/s | Latency 0.93s | Release date— |
|
| Dracarys Llama 3.1 Instruct | Context— | Input— | Output— | Providers +24 | — | — | — | — | — | — | — | — | Throughput 18 t/s | Latency 0.59s | Release date— |
|
| Usdcode Llama 3.1 Instruct | Context— | Input— | Output— | Providers +5 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date— |
|
| Meta Llama 3.1 InstructMeta | Context— | Input— | Output— | Providers +3 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date— |
|
| Meta Llama 3.3 Instruct Turbo | Context— | Input— | Output— | Providers | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date— |
|
| Meta Llama 3.1 Instruct TurboMeta | Context— | Input— | Output— | Providers | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date— |
|
| Llama 3.2 Nemoretriever 300m Embed v1Meta | Context— | Input— | Output— | Providers +14 | — | — | — | — | — | — | — | — | Throughput — | Latency — | Release date— |
|
An AI model directory is a searchable list of models and their comparison data. On LMSpeed, it brings together API price, throughput, first-token latency, provider coverage, and capability data when available.
Start with the metric that matters most for your workload. Then open a model page to compare provider data. Run your own speed test before you use an endpoint in production.
Yes. Price, availability, throughput, and latency can change by model, provider, and time. Use current page values as a comparison signal and confirm with your own endpoint test.
