qwen2.5-vl
2.33s |
| 10 |
30.07 t/s | 0.87s | 5 |
28.12 t/s | 0.92s | 10 |
| qwen/qwen2.5-vl-72b | 19.87 t/s | 2.32s | 15 |
- | -s | 0 |
48.50 t/s |
2.86s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.96 t/s | 2.14s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.50 t/s | 1.89s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 29.26 t/s | 0.90s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 25.25 t/s | 0.74s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 31.27 t/s | 0.78s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 27.90 t/s | 0.75s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 18.43 t/s | 1.11s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 22.54 t/s | 1.67s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 26.01 t/s | 1.85s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 25.89 t/s | 1.36s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 26.91 t/s | 1.79s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 25.00 t/s | 1.77s |
| Aug 12, 01:42 AM | qwen/qwen2.5-vl-32b | 31.14 t/s | 1.65s |
| Aug 12, 01:42 AM | qwen/qwen2.5-vl-32b | 26.23 t/s | 3.59s |
| Aug 12, 01:42 AM | qwen/qwen2.5-vl-32b | 32.78 t/s | 2.01s |
| Aug 12, 01:42 AM | qwen/qwen2.5-vl-32b | 31.31 t/s | 3.23s |
| Aug 12, 01:42 AM | qwen/qwen2.5-vl-32b | 38.78 t/s | 1.81s |