32.22 t/s |
18.61s |
| 10 |
| Qwen/Qwen3-Coder-30B-A3B-Instruct | 109.28 t/s | 1.65s | 10 |
| deepseek-ai/DeepSeek-R1-Distill-Llama-70B | 33.48 t/s | 27.33s | 5 |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-32B | 70.69 t/s | 13.55s | 5 |
| deepseek-ai/DeepSeek-V3 | 35.26 t/s | 1.77s | 5 |
| Qwen/Qwen3-235B-A22B-Instruct-2507 | 31.78 t/s | 3.02s | 5 |
| mistralai/Mistral-Small-Instruct-2409 | 11.68 t/s | 1.15s | 5 |
| Qwen/Qwen3-30B-A3B | 123.38 t/s | 6.13s | 5 |
| Qwen/Qwen3-8B | 76.12 t/s | 9.33s | 5 |
| 时间 | 模型 | 速度 | 延迟 |
|---|---|---|---|
| Nov 26, 03:17 AM | Qwen/Qwen3-30B-A3B | 123.38 t/s | 6.13s |
| Nov 26, 03:13 AM | Qwen/Qwen3-Next-80B-A3B-Instruct | 178.62 t/s | 0.97s |
| Oct 11, 10:15 AM | Qwen/Qwen3-Next-80B-A3B-Instruct | 139.29 t/s | 0.95s |
| Sep 3, 03:55 AM | Qwen/Qwen3-Coder-30B-A3B-Instruct | 114.35 t/s | 1.81s |
| Sep 1, 11:20 AM | Qwen/Qwen3-8B | 76.12 t/s | 9.33s |
| Aug 13, 01:01 PM | deepseek-ai/DeepSeek-R1-0528 | 29.11 t/s | 22.95s |
| Aug 13, 12:59 PM | deepseek-ai/DeepSeek-V3 | 35.26 t/s | 1.77s |
| Aug 13, 12:55 PM | deepseek-ai/DeepSeek-R1-Distill-Llama-70B | 33.48 t/s | 27.33s |
| Aug 13, 12:53 PM | deepseek-ai/DeepSeek-R1-Distill-Qwen-32B | 70.69 t/s | 13.55s |
| Aug 13, 12:49 PM | mistralai/Mistral-Small-Instruct-2409 | 11.68 t/s | 1.15s |
