A unified API gateway for large language models, offering endpoints for chat, embeddings, images, audio, and more with competitive pricing and stability.
| Model | Speed | Latency | Tests |
|---|---|---|---|
| gpt-4o-mini | 94.27 t/s | 1.92s | 5 |
| gpt-4o-mini-2024-07-18 | 89.22 t/s | 10.04s | 5 |
| deepseek-r1 | 49.94 t/s | 2.87s | 5 |
| deepseek-ai/DeepSeek-R1 | 26.57 t/s | 1.64s | 5 |
| Time | Model | Speed | Latency |
|---|---|---|---|
| Feb 19, 02:27 AM | gpt-4o-mini-2024-07-18 | 89.22 t/s | 10.04s |
| Feb 19, 02:26 AM | gpt-4o-mini | 94.27 t/s | 1.92s |
| Feb 19, 02:21 AM | deepseek-r1 | 49.94 t/s | 2.87s |
| Feb 19, 02:16 AM | deepseek-ai/DeepSeek-R1 | 26.57 t/s | 1.64s |