Provides a unified gateway for accessing AI models and offers tools for development and production API management.
| Model | Speed | Latency | Tests |
|---|---|---|---|
| nbot_chat | 53.14 t/s | 1.52s | 60 |
| nbot_embedding | 0.00 t/s | 0.00s | 5 |
| Time | Model | Speed | Latency |
|---|---|---|---|
| Sep 7, 06:29 AM | nbot_chat | 55.75 t/s | 1.23s |
| Sep 7, 05:50 AM | nbot_chat | 54.84 t/s | 1.62s |
| Sep 7, 05:49 AM | nbot_chat | 50.38 t/s | 1.50s |
| Sep 7, 05:48 AM | nbot_chat | 49.68 t/s | 2.68s |
| Sep 7, 05:47 AM | nbot_chat | 54.34 t/s | 1.30s |
| Sep 7, 05:46 AM | nbot_embedding | 0.00 t/s | 0.00s |
| Sep 7, 05:45 AM | nbot_chat | 43.07 t/s | 1.30s |
| Sep 7, 05:44 AM | nbot_chat | 50.56 t/s | 1.29s |
| Sep 7, 05:36 AM | nbot_chat | 59.17 t/s | 1.41s |
| Sep 7, 05:32 AM | nbot_chat | 53.21 t/s | 1.42s |