Nous
·Released on Aug 18, 2024Hermes 3 70B Instruct API Benchmarks, Pricing & Provider Data
Compare Hermes 3 70B Instruct with another model
Choose a model to open its comparison page.
LLM
Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, rea...
Category Performance
Observed-capability estimates with uncertainty reported separately from independent benchmark families.
- Coverage
- 3 / 8
- Methodology
- V3.0
#1Math39.6Estimated2/4 Measured dimensions
80% interval: 27.8–51.4
foundational math40
math_500 · math_500
competition math39.2
aime · aime
proof frontierPrior only
applied tool mathPrior only
#2Reasoning37.8Estimated2/4 Measured dimensions
80% interval: 26.6–48.9
abstract logicPrior only
scientific causal38.7
gpqa · gpqa / hle · hle
multistep constraints36.8
mmlu_pro · mmlu_pro
evidence verificationPrior only
#3Coding36.6Provisional1/4 Measured dimensions
80% interval: 22.7–50.6
code generation36.6
livecodebench · livecodebench / scicode · scicode
repository engineeringPrior only
debugging testingPrior only
tooling qualityPrior only
No data:AgentsKnowledgeMultilingualMultimodalInstruction following
Specifications
Input and output token limits for this model, plus how it ranks on long-context understanding.
INPUT
131.1Ktokens
≈ 157.3 pages of text
OUTPUT
16.4Ktokens
8K128K1M4M
131.1K
Features
Technical Details
- Input
- Output
- Total parameters
- 70B
- Released
- Aug 2024
- Knowledge cutoff
- 2023-12-31
- Tokenizer
- Llama3
- Architecture
- text->text
- Instruct type
- chatml
- Moderated
- No
- Supported parameters
- frequency_penaltylogit_biasmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetop_ktop_p
Rankings
Excels at
Detailed scores
Updated: Aug 23, 2026Pricing
undefined metric} other undefined metrics}}
Input price$0.700/M#101 / 180Output price$0.700/M#31 / 180
Pricing
undefined metric} other undefined metrics}}
Benchmark
LMSpeed rank
Score
Source
Updated
Confidence
Agents
V3.0undefined metric} other undefined metrics}} · No data
No data80% interval30.8–69.20/4 Measured dimensions
Agents
V3.0undefined metric} other undefined metrics}} · No data
Dimensions and evidence
Planning & decompositionPrior only
Tool usePrior only
Environment & long-horizon executionPrior only
Recovery & completion reliabilityPrior only
Coding
V3.0undefined metric} other undefined metrics}} · Provisional
Score36.680% interval22.7–50.61/4 Measured dimensionsLiveCodeBench18.8%#105 / 115SciCode23.1%#184 / 204
Coding
V3.0undefined metric} other undefined metrics}} · Provisional
Dimensions and evidence
Code generation36.6
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
livecodebench · livecodebench · z -0.91 · q 1.00
scicode · scicode · z -1.56 · q 1.00
Repository engineeringPrior only
Debugging & testingPrior only
Tool-assisted development & qualityPrior only
Benchmark
LMSpeed rank
Score
Source
Updated
Confidence
LiveCodeBenchV3 evidence
LMSpeed rank#105
Score18.8%
Sourceartificialanalysis.ai
UpdatedAug 23, 2026
Confidence4
SciCodeV3 evidence
LMSpeed rank#184
Score23.1%
Sourceartificialanalysis.ai
UpdatedAug 23, 2026
Confidence4
Reasoning
V3.0undefined metric} other undefined metrics}} · Estimated
Score37.880% interval26.6–48.92/4 Measured dimensionsMMLU-Pro57.1%#120 / 129GPQA40.1%#200 / 211
Reasoning
V3.0undefined metric} other undefined metrics}} · Estimated
Dimensions and evidence
Abstract logicPrior only
Scientific & causal reasoning38.7
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
gpqa · gpqa · z -1.51 · q 1.00
hle · hle · z -0.88 · q 1.00
Multi-step constraints36.8
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
mmlu_pro · mmlu_pro · z -1.97 · q 1.00
Evidence integration & verificationPrior only
Benchmark
LMSpeed rank
Score
Source
Updated
Confidence
MMLU-ProV3 evidence
LMSpeed rank#120
Score57.1%
Sourceartificialanalysis.ai
UpdatedAug 23, 2026
Confidence4
Knowledge
V3.0undefined metric} other undefined metrics}} · No data
No data80% interval30.8–69.20/4 Measured dimensions
Knowledge
V3.0undefined metric} other undefined metrics}} · No data
Dimensions and evidence
Broad knowledgePrior only
Professional knowledgePrior only
FactualityPrior only
Retrieval & open-book usePrior only
Math
V3.0undefined metric} other undefined metrics}} · Estimated
Score39.680% interval27.8–51.42/4 Measured dimensionsAIME2.3%#66 / 68MATH-50053.8%#68 / 73
Math
V3.0undefined metric} other undefined metrics}} · Estimated
Dimensions and evidence
Foundational math40
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
math_500 · math_500 · z -1.30 · q 1.00
Competition math39.2
undefined family} other undefined families}} · undefined metric} other undefined metrics}}
aime · aime · z -1.46 · q 1.00
Advanced proofsPrior only
Applied & tool-assisted mathPrior only
Benchmark
LMSpeed rank
Score
Source
Updated
Confidence
MATH-500V3 evidence
LMSpeed rank#68
Score53.8%
Sourceartificialanalysis.ai
UpdatedAug 23, 2026
Confidence4
Multilingual
V3.0undefined metric} other undefined metrics}} · No data
No data80% interval30.8–69.20/4 Measured dimensions
Multilingual
V3.0undefined metric} other undefined metrics}} · No data
Dimensions and evidence
Cross-language understandingPrior only
Multilingual generationPrior only
Reasoning transferPrior only
Low-resource robustnessPrior only
Multimodal
V3.0undefined metric} other undefined metrics}} · No data
No data80% interval30.8–69.20/4 Measured dimensions
Multimodal
V3.0undefined metric} other undefined metrics}} · No data
Dimensions and evidence
Perception & OCRPrior only
Document & spatial understandingPrior only
Visual reasoningPrior only
Video & grounded actionPrior only
Instruction following
V3.0undefined metric} other undefined metrics}} · No data
No data80% interval30.8–69.20/4 Measured dimensions
Instruction following
V3.0undefined metric} other undefined metrics}} · No data
Dimensions and evidence
Constraint followingPrior only
Structured outputPrior only
Novel-instruction generalizationPrior only
Multi-turn & long instructionsPrior only
OpenRouter endpoints
1 endpointsThird-party OpenRouter endpoint data, shown separately from LMSpeed measurements. Some 30-minute live performance fields only appear after syncing with an OpenRouter API key.
| Provider endpoint | Input | Output | 1d uptime | 30m latency | 30m throughput | Context / output |
|---|---|---|---|---|---|---|
DeepInfra deepinfra/fp8 | $0.700/M | $0.700/M | 100% | — | — | undefined tokens / undefined tokens |