A self-hosted LLM API gateway that unifies multiple providers with intelligent routing and monitoring.
| Model | Speed | Latency | Tests |
|---|---|---|---|
| moonshotai/Kimi-K2-Instruct | 77.91 t/s | 0.66s | 10 |
| Time | Model | Speed | Latency |
|---|---|---|---|
| Jul 22, 07:58 AM | moonshotai/Kimi-K2-Instruct | 76.11 t/s | 0.71s |
| Jul 22, 07:53 AM | moonshotai/Kimi-K2-Instruct | 79.70 t/s | 0.61s |