Meta

Llama 3.1 API Benchmarks, Pricing & Provider Data

Compare Llama 3.1 with another model

Choose a model to open its comparison page.

Share on X
LLM

Llama 3.1 benchmark, API pricing, and provider data cover 132 API providers, with prices starting at $0.0007/request. Llama 3.1 free API options are available from 2 providers.

Meta Llama 3.1 extends the Llama 3 family with stronger reasoning, tool use, and long-context support across 8B to 405B scales.

Quality
0.0
LMSpeed score
Cost
$0.0007/ 1M · 8:1 in:out
$0.0001 in · $0.0006 out

Category Performance

Observed-capability estimates with uncertainty reported separately from independent benchmark families.

Coverage
5 / 8
Methodology
V3.0
Category PerformanceObserved-capability estimates with uncertainty reported separately from independent benchmark families.Agents37.5Coding45.1Reasoning36.9Knowledge47.3Math-Multilingual-Multimodal-Instruction following43.1
#1Knowledge47.3Provisional1/4 Measured dimensions
80% interval: 31.363.3
broad knowledge47.3
aa_omniscience · aa_omniscience_index
professional knowledgePrior only
factualityPrior only
retrieval open bookPrior only
#2Coding45.1Provisional1/4 Measured dimensions
80% interval: 29.161.0
code generation45.1
scicode · aa_sci_code
repository engineeringPrior only
debugging testingPrior only
tooling qualityPrior only
#3Instruction following43.1Provisional1/4 Measured dimensions
80% interval: 27.159.1
constraint followingPrior only
structured outputPrior only
novel instruction generalization43.1
ifbench · aa_if_bench
long multiturn instructionPrior only
#4Agents37.5Provisional1/4 Measured dimensions
80% interval: 21.553.6
planningPrior only
tool use37.5
tau · tau2_bench
environment executionPrior only
recovery reliabilityPrior only
#5Reasoning36.9Estimated2/4 Measured dimensions
80% interval: 26.247.7
abstract logicPrior only
scientific causal41.2
critpt · critpt / gpqa · aa_gpqa_diamond / hle · aa_hle
multistep constraintsPrior only
evidence verification32.7
lcr · lcr
No data:MathMultilingualMultimodal

Specifications

Technical Details

Documentation

Rankings

Excels at

Falls behind in

Detailed scores

Updated: Aug 14, 2026

Agents

V3.0

undefined metric} other undefined metrics}} · Provisional

Score37.580% interval21.5–53.61/4 Measured dimensionsΤ²-bench results19.0#78 / 82
Dimensions and evidence
Planning & decompositionPrior only
Tool use37.5
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
tau · tau2_bench · z -1.78 · q 1.00
Environment & long-horizon executionPrior only
Recovery & completion reliabilityPrior only
Τ²-bench resultsV3 evidence
LMSpeed rank#78
Score19.0
UpdatedAug 14, 2026
Confidence1

Coding

V3.0

undefined metric} other undefined metrics}} · Provisional

Score45.180% interval29.1–61.01/4 Measured dimensionsAA-SciCode29.9#97 / 108
Dimensions and evidence
Code generation45.1
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
scicode · aa_sci_code · z -0.78 · q 1.00
Repository engineeringPrior only
Debugging & testingPrior only
Tool-assisted development & qualityPrior only
AA-SciCodeV3 evidence
LMSpeed rank#97
Score29.9
UpdatedAug 14, 2026
Confidence1

Reasoning

V3.0

undefined metric} other undefined metrics}} · Estimated

Score36.980% interval26.2–47.72/4 Measured dimensionsAA-LCR24.7#98 / 100
Dimensions and evidence
Abstract logicPrior only
Scientific & causal reasoning41.2
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
critpt · critpt · z -0.72 · q 1.00
gpqa · aa_gpqa_diamond · z -1.10 · q 1.00
hle · aa_hle · z -0.88 · q 1.00
Multi-step constraintsPrior only
Evidence integration & verification32.7
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
lcr · lcr · z -2.66 · q 1.00
AA-LCRV3 evidence
LMSpeed rank#98
Score24.7
UpdatedAug 14, 2026
Confidence1

Knowledge

V3.0

undefined metric} other undefined metrics}} · Provisional

Score47.380% interval31.3–63.31/4 Measured dimensionsArtificial Analysis Intelligence Index8.3#106 / 111AA-GPQA Diamond51.5#103 / 108
Dimensions and evidence
Broad knowledge47.3
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
aa_omniscience · aa_omniscience_index · z -0.44 · q 1.00
Professional knowledgePrior only
FactualityPrior only
Retrieval & open-book usePrior only
Artificial Analysis Intelligence IndexV3 evidence
LMSpeed rank#106
Score8.3
UpdatedAug 14, 2026
Confidence1
AA-GPQA Diamond
LMSpeed rank#103
Score51.5
UpdatedAug 14, 2026
Confidence1
AA-HLE
LMSpeed rank#101
Score4.0
UpdatedAug 14, 2026
Confidence1
AA-Omniscience Accuracy
LMSpeed rank#76
Score23.2
UpdatedAug 14, 2026
Confidence1
AA-Omniscience Hallucination Rate
LMSpeed rank#71
Score52.4
UpdatedAug 14, 2026
Confidence1

Math

V3.0

undefined metric} other undefined metrics}} · No data

No data80% interval30.8–69.20/4 Measured dimensions
Dimensions and evidence
Foundational mathPrior only
Competition mathPrior only
Advanced proofsPrior only
Applied & tool-assisted mathPrior only

Multilingual

V3.0

undefined metric} other undefined metrics}} · No data

No data80% interval30.8–69.20/4 Measured dimensions
Dimensions and evidence
Cross-language understandingPrior only
Multilingual generationPrior only
Reasoning transferPrior only
Low-resource robustnessPrior only

Multimodal

V3.0

undefined metric} other undefined metrics}} · No data

No data80% interval30.8–69.20/4 Measured dimensions
Dimensions and evidence
Perception & OCRPrior only
Document & spatial understandingPrior only
Visual reasoningPrior only
Video & grounded actionPrior only

Instruction following

V3.0

undefined metric} other undefined metrics}} · Provisional

Score43.180% interval27.1–59.11/4 Measured dimensionsAA-IFBench39.0#72 / 84
Dimensions and evidence
Constraint followingPrior only
Structured outputPrior only
Novel-instruction generalization43.1
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
ifbench · aa_if_bench · z -1.20 · q 1.00
Multi-turn & long instructionsPrior only
AA-IFBenchV3 evidence
LMSpeed rank#72
Score39.0
UpdatedAug 14, 2026
Confidence1

Pricing Comparison

Compare Llama 3.1 API pricing across 130 providers. Prices range from $0.0007/request to $75.00/M. 柏拉图AI offers the lowest rate at $0.0007/request. 2 providers offer free API credits or a free tier.

ProviderHealthModel VariantGroupInput ($/M)Output ($/M)Speed (t/s)First tokenAudit
L1
100%
llama-3.1-8b
default
$0.137/M
$0.137/M
L1
100%
llama-3.1-70b
default
$0.274/M
$0.548/M
L1
100%
llama-3.1-405b
default
$0.411/M
$0.822/M
L1
100%
llama-3.1-8b
default
$0.274/M
$0.274/M
L1
100%
llama-3.1-70b
default
$0.548/M
$1.10/M
L1
100%
llama-3.1-405b
default
$0.822/M
$1.64/M
L1
100%
llama-3.1-405b
default
Free
Free
L1
100%
llama-3.1-8b
default
Free
Free
L1
100%
llama-3.1-8b
default
$0.137/M
$0.137/M
L1
100%
llama-3.1-70b
default
$0.274/M
$0.548/M
L1
100%
llama-3.1-405b
default
$0.411/M
$0.822/M
L1
100%
llama-3.1-8b
default
$0.0050/request
-
L1
100%
llama-3.1-405b
default
$0.010/request
-
L1
100%
llama-3.1-70b
default
$0.050/request
-
L1
99%
llama-3.1-8b
default
$0.490/M
$0.817/M
L1
99%
llama-3.1-70b
default
$1.96/M
$1.96/M
L1
99%
llama-3.1-405b
default
$4.90/M
$4.90/M
L1
99%
llama-3.1-70b
default
$2.40/M
$4.80/M
L1
99%
llama-3.1-405b
default
$3.60/M
$7.20/M
L1
99%
llama-3.1-8b
default
$0.255/M
$0.255/M
Showing 20 model IDs of 46.

Alternatives & Similar Models

Frequently Asked Questions

What benchmark data does Llama 3.1 include?
LMSpeed shows Llama 3.1 benchmark context, API price, output speed, first-token latency, and provider data across 132 providers when those signals are available.
What is the Llama 3.1 API price?
Llama 3.1 has pricing from 132 providers, ranging from $0.0007/request to $75.00/M. 柏拉图AI has the lowest listed price.
What does the Llama 3.1 API pricing table include?
The Llama 3.1 API pricing table compares 132 providers by input price, output price, free tier status, speed, first-token latency, and recent health data when available.
Which provider has the cheapest Llama 3.1 API pricing?
柏拉图AI currently has the lowest listed Llama 3.1 price at $0.0007/request across 132 providers.
Is Llama 3.1 API free?
Yes, Llama 3.1 free API options are available through 2 providerundefined other undefined} on LMSpeed, including 兔子API, 兔子API. These providers offer free API credits or a free tier with no per-token charges.
Where can I get Llama 3.1 free API access?
LMSpeed currently lists 2 free API providerundefined other undefined} for Llama 3.1: 兔子API, 兔子API. Check each provider row before using it because free tier limits can change.

Also known as

Llama-3.1-405BLlama-3.1-8Bllama-3-1-405bllama-3.1-405bllama-3.1-70b

Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.Standard benchmark data may include BenchLM and other public sources.

Build with LMSpeed Data

Free

Free public API for LLM pricing, benchmarks & provider data

  • Real-time pricing & availability
  • Speed & latency benchmarks
  • 300+ models, 600+ providers
  • 1,000 requests/day
View API Documentation