GPT Load is an open-source intelligent load balancing platform designed to manage and distribute API requests across multiple AI providers. It provides a unified interface for accessing various AI models, helping developers optimize performance and reliability. Key features include load balancing, failover handling, and request routing. The platform supports integration with different AI APIs, allowing users to switch between providers seamlessly. Typical use cases include AI application development, API management, and ensuring high availability for AI services. The project is available on GitHub under the MIT license.
GPT Load (Shiho)
gpt-load.shiho.top
GPT Load (Shiho) is an OpenAI-compatible API load balancing service hosted at gpt-load.shiho.top, distributing requests across multiple AI model providers for improved reliability.
- Models
- 27 models
- From
- --
- Speed
- 1164 tok/s
- Updated
- 6/8/2026
- Latency
- 0.00 s
- Created At
- 12/7/2025
API Endpoints
- Endpoint 1
gpt-load.shiho.top
Verify ownership to unlock provider management features:
- Edit provider name, content, and links
- Get featured with priority traffic and visibility boost
- Display a verified badge to build user trust
Leaderboard Rankings
Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.
About GPT Load (Shiho)
Health Check
API Benchmarks & Pricing
Compare 21 model rows across audit recency, latest speed tests, throughput, latency, and per-token pricing.
allam-2-7b | - | - | ||||||||||
canopylabs/orpheus-arabic-saudi | - | - | ||||||||||
canopylabs/orpheus-v1-english | - | - | ||||||||||
groq/compound | - | - | ||||||||||
groq/compound-mini | - | - | ||||||||||
llama-3.1-8b-instant | - | - | ||||||||||
llama-3.3-70b-versatile | - | - | ||||||||||
meta-llama/llama-4-scout-17b-16e-instruct | - | - | ||||||||||
meta-llama/llama-prompt-guard-2-22m | - | - | ||||||||||
meta-llama/llama-prompt-guard-2-86m | - | - | ||||||||||
moonshotai/kimi-k2-instruct | - | - | ||||||||||
openai/gpt-oss-20b | - | - | ||||||||||
openai/gpt-oss-safeguard-20b | - | - | ||||||||||
qwen/qwen3-32b | - | - | ||||||||||
whisper-large-v3 | - | - | ||||||||||
whisper-large-v3-turbo | - | - | ||||||||||
| 984.9 t/s | 0.45 s | |||||||||||
llama-4-maverick-17b-128e-instruct | 825.7 t/s | 0.41 s | ||||||||||
llama3.1-8b | 1629.3 t/s | 0.36 s | ||||||||||
qwen-3-235b-a22b-thinking-2507 | 579.8 t/s | 0.44 s | ||||||||||
| 481.9 t/s | 0.43 s |
Showing 21 of 21 model rows
Recent Test Records
| Time | Model | Speed | Latency |
|---|---|---|---|
| Jun 3, 06:58 PM | openai/gpt-oss-120b | 481.90 tok/s | 0.43s |
| Dec 25, 02:06 PM | llama3.1-8b | 2142.09 tok/s | 0.19s |
| Dec 25, 02:02 PM | llama-3.3-70b | 1374.74 tok/s | 0.25s |
| Sep 21, 06:22 PM | llama3.1-8b | 1834.10 tok/s | 0.35s |
| Sep 21, 06:21 PM | llama-4-maverick-17b-128e-instruct | 825.70 tok/s | 0.41s |
| Sep 21, 06:19 PM | llama-3.3-70b | 890.30 tok/s | 0.51s |
| Sep 21, 06:18 PM | qwen-3-235b-a22b-thinking-2507 | 579.82 tok/s | 0.44s |
| Sep 21, 06:17 PM | llama3.1-8b | 2117.91 tok/s | 0.34s |
| Jun 8, 11:00 PM | llama3.1-8b | 806.21 tok/s | 0.47s |
| Jun 8, 10:59 PM | llama-3.3-70b | 794.97 tok/s | 0.52s |
Similar API Provider Alternatives to Compare
Compare GPT Load (Shiho) alternatives against 6 nearby API providers using 105 LMSpeed signals across shared model coverage, pricing, benchmark speed, uptime, and free-model availability.
| Provider | Why compare | Models | Free | Avg price | Speed | 30d uptime |
|---|---|---|---|---|---|---|
| GPT Load (Shiho) gpt-load-shiho-top GPT Load (Shiho) is an OpenAI-compatible API load balancing service hosted at gpt-load.shiho.top, distributing requests across multiple AI model providers for improved reliability. | Current provider baseline | 27 | 0 | N/A | 1164 tok/s | 9990% |
| 钱多多 API api2-aigcbest-top Provides AI-generated content APIs for various applications, including text and image generation. |
| 1,418 | 2 | $0.0025/M | 101 tok/s | 9940% |
| Koyeb AI Gateway new-api-koyeb-app An OpenAI-compatible API gateway deployed on Koyeb, providing access to multiple AI models. |
| 578 | 420 | N/A | 33 tok/s | 9960% |
| 艾可API aicanapi-com AicanAPI provides an enterprise-grade API management platform with high-performance architecture, security compliance, and cost optimization for business digital transformation. |
| 545 | 103 | N/A | 70 tok/s | 5790% |
| APIMart apimart APIMart is a pay-as-you-go, OpenAI-compatible AI API gateway operated by Hangzhou Huanzhi Network Technology Co., Ltd. It provides unified access to more than 500 third-party text, image, video, and audio models, with consolidated billing, multi-provider routing, and automatic failover. |
| 257 | 16 | $0.015/M | N/A | 9980% |
| C85 API c85-api C85 API is an OpenAI-compatible API gateway built on the New API panel, providing unified access to multiple AI models through a hosted endpoint. |
| 188 | 130 | N/A | N/A | 0% |
| 91VIP API hcg-pippi-top A unified API gateway providing access to multiple large language models and AI services with competitive pricing and stability. |
| 181 | 30 | $0.467/M | 148 tok/s | 9890% |
Notes
- Health checks: Scope: the 72-hour chart and recent availability measure API connectivity only. Each bar summarizes one hour of checks. Targets: LMSpeed tries the configured health check URL and provider status URL first, then API endpoints derived from known API hosts and recent speed-test base URLs. A website host is considered only when it looks like an API endpoint. Probe steps: each candidate goes through DNS lookup, TCP connection, TLS handshake for HTTPS, and an HTTP HEAD request with redirects followed. Probing stops after the first reachable candidate. Reachable criteria: every required network step must succeed. An HTTP response below 500 is treated as reachable, including 401 because it confirms that an authenticated API endpoint responded, except for statuses classified as blocked. Blocked results: HTTP 403, 429, 521, 525, and 530, plus detected WAF or Cloudflare challenges, are shown as blocked and excluded from availability calculations because LMSpeed cannot determine whether the API itself is down. Model availability: when a dedicated test key is configured, LMSpeed sends an authenticated GET request to a derived /models endpoint and compares returned model IDs with this provider's listed models. These per-model results appear in Models & Pricing and are not included in the provider connectivity percentage. Timeouts: TCP connection, TLS handshake, HTTP connectivity, and model requests each use a 20-second timeout. A full run can take longer when several candidates are tried. Frequency: a background worker checks all providers every 5 minutes by default. The 72-hour chart combines those samples into hourly bars, and the schedule may be changed by the service operator. Limit: automated samples are not an SLA and do not guarantee account quota, every model, every region, or successful completion requests. Check the provider's own status page before making operational decisions.
- Domain Rating data is sourced from Ahrefs. It is a 0–100 backlink-based domain strength signal and does not measure API speed or reliability.
- Announcements and FAQ are read from this provider's NewAPI status snapshot when available. LMSpeed stores the original content and optional English translations from the provider status source, then shows the localized fields on this page.

