qwen2.5-vl
1.03s |
| 5 |
| qwen/qwen2.5-vl-32b | 40.82 t/s | 2.33s | 10 |
30.07 t/s | 0.87s | 5 |
28.12 t/s | 0.92s | 10 |
| qwen/qwen2.5-vl-72b | 19.87 t/s | 2.32s | 15 |
- | -s | 0 |
42.91 t/s |
0.79s |
| Jan 30, 07:15 PM | qwen2.5-vl-72b-instruct | 42.92 t/s | 0.98s |
| Jan 30, 07:15 PM | qwen2.5-vl-72b-instruct | 43.66 t/s | 0.82s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 50.15 t/s | 2.34s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.83 t/s | 1.75s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 48.50 t/s | 2.86s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.96 t/s | 2.14s |
| Nov 20, 10:42 AM | qwen/qwen2.5-vl-32b | 49.50 t/s | 1.89s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 29.26 t/s | 0.90s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 25.25 t/s | 0.74s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 31.27 t/s | 0.78s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 27.90 t/s | 0.75s |
| Oct 6, 02:35 PM | Qwen/Qwen2.5-VL-72B-Instruct | 18.43 t/s | 1.11s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 22.54 t/s | 1.67s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 26.01 t/s | 1.85s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 25.89 t/s | 1.36s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 26.91 t/s | 1.79s |
| Aug 12, 01:46 AM | qwen/qwen2.5-vl-72b | 25.00 t/s | 1.77s |