API Provider Performance Test Results
| Model Name | Test Count | Average Output Speed | Average First Token Latency |
|---|---|---|---|
Meta-Llama-3-3-70B-Instruct | 5 | 47.61 t/s | 0.93s |
Total Tests
33.78 - 57.31 t/s
0.65 - 1.40s
Last Test Time
Meta-Llama-3-3-70B-Instruct
Test Count: 5
47.61 t/s
Average Speed
| Test Time | Model | Average Output Speed | Average First Token Latency | Total Tokens |
|---|---|---|---|---|
| 2/24/2025, 8:41:19 AM | Meta-Llama-3-3-70B-Instruct | 47.61 t/s | 0.93s | 2235 |