Data points: 71
Model compare
The readout for GPT-OSS and Hermes 3 Llama 3.1, before the detailed comparison sheet.
Weighted outcome: GPT-OSS. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Decision read
GPT-OSS
GPT-OSS has the higher weighted result; Model A / B score 100 to 0.
Evidence depth
71 data points
Includes 0 benchmark rows, 1 audit samples, and 6 provider examples.
Selection signal
Start with GPT-OSS
The charts below split 7 high-signal samples across speed, scores, and audit health.
Switch either side of this report to compare another model with the same LMSpeed data pipeline.
Select a different model to open a new comparison URL.
This report only uses LMSpeed data for GPT-OSS and Hermes 3 Llama 3.1: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
| Model compare | GPT-OSS | Hermes 3 Llama 3.1 |
|---|---|---|
| Overall leader | Leading | Contender |
| Weighted overall score | 100.0 pts | 0.0 pts |
| Benchmark category leads | 0 categories | 0 categories |
| Operational advantages | Cheapest input price, Free providers, Provider coverage | No data |
| Context window | 131.1K tokens | 131.1K tokens |
| Max output | 131.1K tokens | 16.4K tokens |
| Modalities | Input Text Output Text | Input Text |
The overall result weights benchmark capability categories at 80% and price, API speed/latency, and availability at 20%. Recent test volume does not affect the winner, and missing benchmark categories are excluded.
| Model compare | GPT-OSS | Hermes 3 Llama 3.1 |
|---|---|---|
| Developer | No data | No data |
| Released | Aug 2025 | Aug 2024 |
| Parameters | 120B | 70B |
| Tokenizer | GPT | Llama3 |
| Knowledge cutoff | 2024-06-30 | 2023-12-31 |
| OpenRouter ID | openai/gpt-oss-120b:free | nousresearch/hermes-3-llama-3.1-70b |
| References | No data | No data |
This report only uses LMSpeed data for GPT-OSS and Hermes 3 Llama 3.1: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.
GPT-OSS
GPT-OSS has these operational advantages: Cheapest input price, Free providers, Provider coverage.
Hermes 3 Llama 3.1
Hermes 3 Llama 3.1 does not clearly lead in the benchmark or operational dimensions shared by both models.
Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.
Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.
No shared professional benchmark scores are available yet.
Latest completed audits from shared providers, with four safety and integrity score groups plus report links.
| Provider | GPT-OSS | Hermes 3 Llama 3.1 |
|---|---|---|
Winner: GPT-OSS | GPT-OSS openai/gpt-oss-120b:free Audit score 93 1008486100 | Hermes 3 Llama 3.1 nousresearch/hermes-3-llama-3.1-405b:free No audit yet |
Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.
| Provider | GPT-OSS | Hermes 3 Llama 3.1 |
|---|---|---|
40 tests | GPT-OSS speed / latency 41 tok/s / 2851ms input / output No data | Hermes 3 Llama 3.1 speed / latency N/A / N/A input / output No data |
35 tests | GPT-OSS speed / latency 1061 tok/s / 857ms input / output No data | Hermes 3 Llama 3.1 speed / latency N/A / N/A input / output No data |
35 tests | GPT-OSS speed / latency 347 tok/s / 2670ms input / output No data | Hermes 3 Llama 3.1 speed / latency N/A / N/A input / output No data |
5 tests | GPT-OSS speed / latency 1345 tok/s / 384ms input / output No data | Hermes 3 Llama 3.1 speed / latency N/A / N/A input / output No data |
0 tests | GPT-OSS speed / latency N/A / N/A input / output No data | Hermes 3 Llama 3.1 speed / latency N/A / N/A input / output No data |
GPT-OSS openai/gpt-oss-20b speed / latency No data input / output $0.040/M/$0.150/M | Hermes 3 Llama 3.1 nousresearch/hermes-3-llama-3.1-405b:free speed / latency No data input / output $0/M |
Weighted outcome: GPT-OSS. Benchmark capability categories carry 80%, while price, API performance, and availability carry 20%.
Output
| Features | Text inputText outputTool callingReasoning | Text inputText outputStructured outputsJSON mode |
|---|
