Ollama provides a platform to run and integrate open-source AI models locally or in the cloud.
Ollama offers 3 LLM API models.
Speed benchmark average: 53 tok/s.
ollama.com
