llama-3.2
213.91 t/s |
6.14s |
| Feb 18, 08:39 AM | meta/llama-3.2-1b-instruct | 245.53 t/s | 5.37s |
| Feb 18, 08:39 AM | meta/llama-3.2-1b-instruct | 427.35 t/s | 5.65s |
| Feb 18, 08:39 AM | meta/llama-3.2-3b-instruct | 110.23 t/s | 0.97s |
| Feb 18, 08:39 AM | meta/llama-3.2-3b-instruct | 106.39 t/s | 0.95s |
| Feb 18, 08:39 AM | meta/llama-3.2-3b-instruct | 96.91 t/s | 0.45s |
| Feb 18, 08:39 AM | meta/llama-3.2-3b-instruct | 96.51 t/s | 0.44s |
| Feb 18, 08:39 AM | meta/llama-3.2-3b-instruct | 96.95 t/s | 0.45s |
| Feb 18, 08:27 AM | meta/llama-3.2-1b-instruct | 350.15 t/s | 5.53s |
| Feb 18, 08:27 AM | meta/llama-3.2-1b-instruct | 227.93 t/s | 5.55s |
| Feb 18, 08:27 AM | meta/llama-3.2-1b-instruct | 330.43 t/s | 5.17s |
| Feb 18, 08:27 AM | meta/llama-3.2-1b-instruct | 236.90 t/s | 4.74s |
| Feb 18, 08:27 AM | meta/llama-3.2-1b-instruct | 147.85 t/s | 4.55s |