ModelScope

Name: ModelScope
Rating: 2.9 (108 reviews)

ModelScope provides model inference API access to a wide range of open-source AI models via OpenAI-compatible endpoints.

ModelScope offers 18 LLM API models.

Speed benchmark average: 56 tok/s.

ModelScope is an API aggregator, offering models from multiple vendors.

Avg Speed58.21 tok/s

Latency5.76 s

Total Tests108

Models18

Updated4/12/2026

Created At12/7/2025

Recent Test Records

Time	Model	Speed	Latency
Mar 30, 04:09 AM	kgiser/gpu_gpt_5	26.05 tok/s	1.11s
Mar 30, 03:24 AM	kgiser/gpu_gpt_5	30.59 tok/s	1.17s
Mar 30, 03:16 AM	TeichAI/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-GGUF	13.07 tok/s	2.17s
Mar 30, 02:41 AM	Qwen/QVQ-72B-Preview	44.75 tok/s	1.16s
Mar 30, 02:39 AM	Qwen/Qwen3-Coder-480B-A35B-Instruct	61.17 tok/s	0.94s
Mar 30, 02:37 AM	moonshotai/Kimi-K2.5	43.12 tok/s	1.11s
Mar 30, 02:32 AM	MiniMax/MiniMax-M2.5	52.75 tok/s	7.49s
Mar 26, 07:23 AM	deepseek-ai/DeepSeek-V3.2	29.48 tok/s	1.88s
Mar 24, 10:21 AM	Qwen/Qwen3-4B	126.44 tok/s	4.27s
Mar 8, 03:28 AM	Qwen/QVQ-72B-Preview	45.09 tok/s	1.15s