ngrok provides a unified gateway platform for secure connectivity, API management, and AI model access.
| Model | Speed | Latency | Tests |
|---|---|---|---|
| openai/gpt-oss-20b | 24.87 t/s | 3.82s | 5 |
| qwen/qwen3-coder-30b | 18.83 t/s | 2.36s | 10 |
| qwen/qwen3-coder-30b | 18.83 t/s | 2.36s | 10 |
| Time | Model | Speed | Latency |
|---|---|---|---|
| Oct 11, 06:21 AM | qwen/qwen3-coder-30b | 15.80 t/s | 1.40s |
| Oct 11, 05:04 AM | openai/gpt-oss-20b | 24.87 t/s | 3.82s |
| Oct 11, 04:55 AM | qwen/qwen3-coder-30b | 21.87 t/s | 3.32s |