qwen2
Showing 1-56 of 56 providers
| Variant | Speed | Latency | Tests |
|---|---|---|---|
 | 213.84 t/s | 0.67s | 5 |
| 204.04 t/s | 0.60s | 5 |
|
| Time | Model | Speed | Latency |
|---|---|---|---|
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 50.15 t/s | 2.34s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.83 t/s | 1.75s |
| Nov 20, 10:42 AM |
203.36 t/s |
0.68s |
| 5 |
| Pro/Qwen/Qwen2-VL-7B-Instruct | 93.23 t/s | 0.71s | 5 |
| 免费Qwen2-7B | 93.01 t/s | 0.85s | 10 |
 qwen2.5-72b-instruct | 92.64 t/s | 2.57s | 10 |
 qwen2.5-7b-instruct-1m | 92.57 t/s | 0.93s | 10 |
| Pro/Qwen/Qwen2.5-VL-7B-Instruct | 85.51 t/s | 0.76s | 5 |
| Qwen/Qwen2-7B-Instruct | 83.88 t/s | 0.59s | 30 |
 Pro/Qwen/Qwen2-7B-Instruct | 83.77 t/s | 0.60s | 10 |
| 免费Qwen2.5-14B | 77.95 t/s | 0.69s | 5 |
| 免费Qwen2-VL-7B | 77.82 t/s | 0.95s | 10 |
| qwen/qwen2.5-7b | 72.53 t/s | 1.95s | 50 |
| Qwen/Qwen2.5-14B-Instruct | 71.24 t/s | 0.65s | 10 |
| LoRA/Qwen/Qwen2.5-32B-Instruct | 64.68 t/s | 0.84s | 5 |
| 免费Qwen2.5-VL-7B | 63.63 t/s | 1.03s | 10 |
| qwen/qwen2.5-72b | 63.32 t/s | 1.90s | 50 |
 Qwen/Qwen2.5-Coder-7B-Instruct | 62.24 t/s | 0.50s | 35 |
| qwen2.5-coder-0.5b-instruct | 60.38 t/s | 0.75s | 5 |
| Qwen/Qwen2.5-32B-Instruct | 58.60 t/s | 0.73s | 20 |
| LoRA/Qwen/Qwen2.5-14B-Instruct | 58.12 t/s | 1.02s | 5 |
| qwen2.5-14b-instruct-1m | 51.72 t/s | 1.37s | 5 |
| qwen2.5-14b-instruct | 49.95 t/s | 0.96s | 5 |
| qwen/qwen2.5-vl-32b | 40.82 t/s | 2.33s | 10 |
| qwen2.5-coder-3b-instruct | 38.45 t/s | 1.00s | 5 |
| qwen2.5-7b-instruct | 34.15 t/s | 1.01s | 5 |
| Qwen/Qwen2.5-72B-Instruct | 32.06 t/s | 0.93s | 5 |
| Qwen/Qwen2.5-VL-32B-Instruct | 30.07 t/s | 0.87s | 5 |
 Qwen/Qwen2.5-72B-Instruct | 29.84 t/s | 1.01s | 40 |
| Qwen/Qwen2-VL-72B-Instruct | 28.50 t/s | 0.78s | 5 |
| Pro/Qwen/Qwen2.5-Coder-7B-Instruct | 28.32 t/s | 0.63s | 5 |
| Qwen/Qwen2.5-7B-Instruct | 28.27 t/s | 1.53s | 30 |
| qwen2.5-72b-instruct | 28.17 t/s | 0.97s | 5 |
| Qwen/Qwen2.5-VL-72B-Instruct | 28.12 t/s | 0.92s | 10 |
| qwen2.5-coder-32b-instruct | 28.02 t/s | 1.02s | 5 |
| Vendor-A/Qwen/Qwen2.5-72B-Instruct | 27.74 t/s | 1.25s | 5 |
| LoRA/Qwen/Qwen2.5-72B-Instruct | 24.64 t/s | 3.37s | 5 |
| Qwen/Qwen2.5-Coder-32B-Instruct | 23.58 t/s | 1.18s | 5 |
| Pro/Qwen/Qwen2.5-7B-Instruct | 20.74 t/s | 0.87s | 5 |
| Qwen/Qwen2.5-72B-Instruct-128K | 20.28 t/s | 0.90s | 10 |
| qwen/qwen2.5-vl-72b | 19.87 t/s | 2.32s | 15 |
| qwen2.5-mlx | 12.58 t/s | 1.29s | 5 |
| qwen2.5:32b | - | -s | 0 |
 qwen2.5-7b-instruct | - | -s | 0 |
 qwen2.5-14b-instruct | - | -s | 0 |
| qwen2.5 | - | -s | 0 |
| Qwen/Qwen2.5-32B-Instruct | - | -s | 0 |
| Pro/Qwen/Qwen2-7B-Instruct | - | -s | 0 |
| Qwen/Qwen2-7B-Instruct | - | -s | 0 |
| Qwen/Qwen2.5-VL-72B-Instruct | - | -s | 0 |
| Qwen/Qwen2.5-72B-Instruct | - | -s | 0 |
| Qwen/Qwen2.5-Coder-7B-Instruct | - | -s | 0 |
| Qwen/Qwen2.5-7B-Instruct | - | -s | 0 |
| Qwen/Qwen2.5-14B-Instruct | - | -s | 0 |
| Qwen/Qwen2.5-72B-Instruct-128K | - | -s | 0 |
 qwen2.5-7b-instruct | - | -s | 0 |
48.50 t/s |
2.86s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.96 t/s | 2.14s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.50 t/s | 1.89s |
| Nov 8, 09:38 AM | qwen/qwen2.5-7b | 102.30 t/s | 0.49s |
| Nov 8, 09:38 AM | qwen/qwen2.5-7b | 102.06 t/s | 0.38s |
| Nov 8, 09:38 AM | qwen/qwen2.5-7b | 92.74 t/s | 0.40s |
| Nov 8, 09:38 AM | qwen/qwen2.5-7b | 104.28 t/s | 1.01s |
| Nov 8, 09:38 AM | qwen/qwen2.5-7b | 96.72 t/s | 0.40s |
| Nov 8, 09:37 AM | qwen/qwen2.5-7b | 103.11 t/s | 1.20s |
| Nov 8, 09:37 AM | qwen/qwen2.5-7b | 101.22 t/s | 0.42s |
| Nov 8, 09:37 AM | qwen/qwen2.5-7b | 100.49 t/s | 0.42s |
| Nov 8, 09:37 AM | qwen/qwen2.5-7b | 105.75 t/s | 0.40s |
| Nov 8, 09:37 AM | qwen/qwen2.5-7b | 97.90 t/s | 0.37s |
| Nov 6, 05:55 AM | Qwen/Qwen2.5-Coder-7B-Instruct | 23.29 t/s | 1.03s |
| Nov 6, 05:55 AM | Qwen/Qwen2.5-Coder-7B-Instruct | 28.00 t/s | 0.67s |
| Nov 6, 05:55 AM | Qwen/Qwen2.5-Coder-7B-Instruct | 26.01 t/s | 0.63s |
| Nov 6, 05:55 AM | Qwen/Qwen2.5-Coder-7B-Instruct | 30.11 t/s | 0.62s |
| Nov 6, 05:55 AM | Qwen/Qwen2.5-Coder-7B-Instruct | 27.16 t/s | 0.62s |