gpt-load.shiho.top

GPT Load (Shiho) is an OpenAI-compatible API load balancing service hosted at gpt-load.shiho.top, distributing requests across multiple AI model providers for improved reliability.

Models
27 models
From
--
Speed
1164 tok/s
Updated
6/8/2026
Latency
0.00 s
Created At
12/7/2025

API Endpoints

  • Endpoint 1
    gpt-load.shiho.top
Claim this provider

Verify ownership to unlock provider management features:

  • Edit provider name, content, and links
  • Get featured with priority traffic and visibility boost
  • Display a verified badge to build user trust

Leaderboard Rankings

Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.

About GPT Load (Shiho)

GPT Load is an open-source intelligent load balancing platform designed to manage and distribute API requests across multiple AI providers. It provides a unified interface for accessing various AI models, helping developers optimize performance and reliability. Key features include load balancing, failover handling, and request routing. The platform supports integration with different AI APIs, allowing users to switch between providers seamlessly. Typical use cases include AI application development, API management, and ensuring high availability for AI services. The project is available on GitHub under the MIT license.

Health Check

100%Recent availability
History (72 pts)
PastNow

API Benchmarks & Pricing

Compare 21 model rows across audit recency, latest speed tests, throughput, latency, and per-token pricing.

Model
Speed
Latency
allam-2-7b
--
canopylabs/orpheus-arabic-saudi
--
canopylabs/orpheus-v1-english
--
groq/compound
--
groq/compound-mini
--
llama-3.1-8b-instant
--
llama-3.3-70b-versatile
--
meta-llama/llama-4-scout-17b-16e-instruct
--
meta-llama/llama-prompt-guard-2-22m
--
meta-llama/llama-prompt-guard-2-86m
--
moonshotai/kimi-k2-instruct
--
openai/gpt-oss-20b
--
openai/gpt-oss-safeguard-20b
--
qwen/qwen3-32b
--
whisper-large-v3
--
whisper-large-v3-turbo
--
984.9 t/s0.45 s
llama-4-maverick-17b-128e-instruct
825.7 t/s0.41 s
llama3.1-8b
1629.3 t/s0.36 s
qwen-3-235b-a22b-thinking-2507
579.8 t/s0.44 s
481.9 t/s0.43 s

Showing 21 of 21 model rows

Recent Test Records

TimeModelSpeedLatency
Jun 3, 06:58 PM
openai/gpt-oss-120b
481.90 tok/s
0.43s
Dec 25, 02:06 PM
llama3.1-8b
2142.09 tok/s
0.19s
Dec 25, 02:02 PM
llama-3.3-70b
1374.74 tok/s
0.25s
Sep 21, 06:22 PM
llama3.1-8b
1834.10 tok/s
0.35s
Sep 21, 06:21 PM
llama-4-maverick-17b-128e-instruct
825.70 tok/s
0.41s
Sep 21, 06:19 PM
llama-3.3-70b
890.30 tok/s
0.51s
Sep 21, 06:18 PM
qwen-3-235b-a22b-thinking-2507
579.82 tok/s
0.44s
Sep 21, 06:17 PM
llama3.1-8b
2117.91 tok/s
0.34s
Jun 8, 11:00 PM
llama3.1-8b
806.21 tok/s
0.47s
Jun 8, 10:59 PM
llama-3.3-70b
794.97 tok/s
0.52s

Similar API Provider Alternatives to Compare

Compare GPT Load (Shiho) alternatives against 6 nearby API providers using 105 LMSpeed signals across shared model coverage, pricing, benchmark speed, uptime, and free-model availability.

ProviderWhy compareModelsFreeAvg priceSpeed30d uptime
GPT Load (Shiho)

gpt-load-shiho-top

GPT Load (Shiho) is an OpenAI-compatible API load balancing service hosted at gpt-load.shiho.top, distributing requests across multiple AI model providers for improved reliability.

Current provider baseline270N/A1164 tok/s9990%
钱多多 API

api2-aigcbest-top

Provides AI-generated content APIs for various applications, including text and image generation.

  • More free-model options
  • Broader model coverage
1,4182$0.0025/M101 tok/s9940%
Koyeb AI Gateway

new-api-koyeb-app

An OpenAI-compatible API gateway deployed on Koyeb, providing access to multiple AI models.

  • More free-model options
  • Broader model coverage
578420N/A33 tok/s9960%
艾可API

aicanapi-com

AicanAPI provides an enterprise-grade API management platform with high-performance architecture, security compliance, and cost optimization for business digital transformation.

  • More free-model options
  • Broader model coverage
545103N/A70 tok/s5790%
APIMart

apimart

APIMart is a pay-as-you-go, OpenAI-compatible AI API gateway operated by Hangzhou Huanzhi Network Technology Co., Ltd. It provides unified access to more than 500 third-party text, image, video, and audio models, with consolidated billing, multi-provider routing, and automatic failover.

  • More free-model options
  • Broader model coverage
25716$0.015/MN/A9980%
C85 API

c85-api

C85 API is an OpenAI-compatible API gateway built on the New API panel, providing unified access to multiple AI models through a hosted endpoint.

  • More free-model options
  • Broader model coverage
188130N/AN/A0%
91VIP API

hcg-pippi-top

A unified API gateway providing access to multiple large language models and AI services with competitive pricing and stability.

  • More free-model options
  • Broader model coverage
18130$0.467/M148 tok/s9890%

Notes

  • Health checks: Scope: the 72-hour chart and recent availability measure API connectivity only. Each bar summarizes one hour of checks. Targets: LMSpeed tries the configured health check URL and provider status URL first, then API endpoints derived from known API hosts and recent speed-test base URLs. A website host is considered only when it looks like an API endpoint. Probe steps: each candidate goes through DNS lookup, TCP connection, TLS handshake for HTTPS, and an HTTP HEAD request with redirects followed. Probing stops after the first reachable candidate. Reachable criteria: every required network step must succeed. An HTTP response below 500 is treated as reachable, including 401 because it confirms that an authenticated API endpoint responded, except for statuses classified as blocked. Blocked results: HTTP 403, 429, 521, 525, and 530, plus detected WAF or Cloudflare challenges, are shown as blocked and excluded from availability calculations because LMSpeed cannot determine whether the API itself is down. Model availability: when a dedicated test key is configured, LMSpeed sends an authenticated GET request to a derived /models endpoint and compares returned model IDs with this provider's listed models. These per-model results appear in Models & Pricing and are not included in the provider connectivity percentage. Timeouts: TCP connection, TLS handshake, HTTP connectivity, and model requests each use a 20-second timeout. A full run can take longer when several candidates are tried. Frequency: a background worker checks all providers every 5 minutes by default. The 72-hour chart combines those samples into hourly bars, and the schedule may be changed by the service operator. Limit: automated samples are not an SLA and do not guarantee account quota, every model, every region, or successful completion requests. Check the provider's own status page before making operational decisions.
  • Domain Rating data is sourced from Ahrefs. It is a 0–100 backlink-based domain strength signal and does not measure API speed or reliability.
  • Announcements and FAQ are read from this provider's NewAPI status snapshot when available. LMSpeed stores the original content and optional English translations from the provider status source, then shows the localized fields on this page.