Groq provides fast and low-cost AI inference through its LPU architecture and GroqCloud platform.

Models
20 models
From
--
Speed
20 tok/s
Updated
7/8/2026
Latency
0.00 s
Created At
12/8/2025

API Endpoints

  • Endpoint 1
    api.groq.com
Claim this provider

Verify ownership to unlock provider management features:

  • Edit provider name, content, and links
  • Get featured with priority traffic and visibility boost
  • Display a verified badge to build user trust

Leaderboard Rankings

Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.

About Groq

Groq offers AI inference services via its GroqCloud platform, built on the LPU (Language Processing Unit) architecture designed for speed and affordability at scale. Key capabilities include high-performance inference for AI models, with a focus on low latency and cost efficiency. The platform supports developers and enterprises, providing API access for building AI applications. Notable strengths include fast inference speeds and competitive pricing, as highlighted in customer stories and demos. Typical use cases involve AI-powered applications in various industries, such as those demonstrated by partners like McLaren F1 Team, Dropbox, Vercel, and others. The service includes free API keys, documentation, and community support for developers.

Health Check

100%Recent availability
History (72 pts)
PastNow

API Benchmarks & Pricing

Compare 20 model rows across audit recency, latest speed tests, throughput, latency, and per-token pricing.

Model
Speed
Latency
qwen/qwen3.8-27b
--
qwen/qwen3.6-27b
--
allam-2-7b
--
canopylabs/orpheus-arabic-saudi
--
canopylabs/orpheus-v1-english
--
groq/compound
--
groq/compound-mini
--
llama-3.1-8b-instant
--
llama-3.3-70b-versatile
--
meta-llama/llama-4-scout-17b-16e-instruct
447.8 t/s0.20 s
meta-llama/llama-prompt-guard-2-22m
--
meta-llama/llama-prompt-guard-2-86m
--
openai/gpt-oss-120b
--
openai/gpt-oss-20b
--
openai/gpt-oss-safeguard-20b
--
qwen/qwen3-32b
--
whisper-large-v3
--
whisper-large-v3-turbo
--
19.7 t/s25.30 s
53.0 t/s8.89 s

Showing 20 of 20 model rows

Free resources

Community-shared API keys and redeem codes associated with Groq.

Free API keys

4
View all
API key / StatusAPI URLModelsSubmitted

gsk_nQ***NEXF

Available
https://api.groq.com/openai/v1openai/gpt-oss-safeguard-20b · whisper-large-v3 · +12Dmitry· Aug 2, 2026

gsk_lg***2sgD

Available
https://api.groq.com/openai/v1openai/gpt-oss-20b · meta-llama/llama-prompt-guard-2-86m · +12Dmitry· Aug 2, 2026

gsk_Jb***M5b4

Available
https://api.groq.com/openai/v1openai/gpt-oss-120b · meta-llama/llama-prompt-guard-2-86m · +12Dmitry· Aug 2, 2026

gsk_RZ***MiW6

Available
https://api.groq.com/openai/v1meta-llama/llama-prompt-guard-2-86m · allam-2-7b · +12Dmitry· Aug 2, 2026

Recent Test Records

TimeModelSpeedLatency
Apr 25, 11:32 PM
meta-llama/llama-4-scout-17b-16e-instruct
447.76 tok/s
0.20s
Dec 23, 03:21 PM
free:Qwen3-30B-A3B
23.23 tok/s
18.61s
Dec 20, 02:59 AM
free:Qwen3-30B-A3B
24.49 tok/s
13.14s
Dec 18, 08:29 AM
free:Qwen3-30B-A3B
30.07 tok/s
9.45s
Dec 18, 04:35 AM
free:Qwen3-30B-A3B
22.38 tok/s
27.29s
Dec 17, 09:28 AM
free:Qwen3-30B-A3B
24.97 tok/s
15.03s
Dec 16, 12:22 PM
free:Qwen3-30B-A3B
21.75 tok/s
4.61s
Dec 16, 07:52 AM
free:Qwen3-30B-A3B
19.47 tok/s
23.58s
Dec 14, 04:14 PM
free:Qwen3-30B-A3B
29.29 tok/s
5.65s
Dec 13, 03:57 PM
free:Qwen3-30B-A3B
21.04 tok/s
1.45s

Similar API Provider Alternatives to Compare

Compare Groq alternatives against 6 nearby API providers using 96 LMSpeed signals across shared model coverage, pricing, benchmark speed, uptime, and free-model availability.

ProviderWhy compareModelsFreeAvg priceSpeed30d uptime
Groq

groq

Groq provides fast and low-cost AI inference through its LPU architecture and GroqCloud platform.

Current provider baseline200N/A20 tok/s9670%
OpenRouter

openrouter

A unified API interface providing access to over 300 models from 60+ providers, including OpenAI, Anthropic, and Google.

  • Faster measured speed
  • Higher 30-day availability
  • Broader model coverage
  • Same provider category
5610N/A85 tok/s9990%
NVIDIA NIM

nvidia-nim

NVIDIA NIM provides optimized AI model inference APIs for LLMs, vision, and embedding models through NVIDIA cloud infrastructure.

  • Faster measured speed
  • Higher 30-day availability
  • Broader model coverage
  • Same provider category
1660N/A78 tok/s9960%
七牛云

qiniu-2

七牛云提供AI大模型推理服务,包括多种模型调用、智能问答助手、代码助手等企业级AI解决方案。

  • Faster measured speed
  • Higher 30-day availability
  • Broader model coverage
  • Same provider category
890N/A90 tok/s9980%
SophNet

www-sophnet-com

An AI development platform offering API access to models like DeepSeek and Qwen for tasks such as text generation and code creation.

  • Faster measured speed
  • Higher 30-day availability
  • Broader model coverage
  • Same provider category
720N/A122 tok/s9960%
SiliconFlow

siliconflow

Provides cost-effective generative AI cloud services based on open-source models for text, image, video, and audio generation.

  • Faster measured speed
  • Broader model coverage
  • Same provider category
1540N/A59 tok/s4340%
Novita AI

novita-ai

Provides a unified API for accessing 200+ AI models, custom model deployment, GPU cloud services, and secure agent sandboxes.

  • Faster measured speed
  • Broader model coverage
  • Same provider category
1420N/A56 tok/s6800%

Notes

  • Health checks: Scope: the 72-hour chart and recent availability measure API connectivity only. Each bar summarizes one hour of checks. Targets: LMSpeed tries the configured health check URL and provider status URL first, then API endpoints derived from known API hosts and recent speed-test base URLs. A website host is considered only when it looks like an API endpoint. Probe steps: each candidate goes through DNS lookup, TCP connection, TLS handshake for HTTPS, and an HTTP HEAD request with redirects followed. Probing stops after the first reachable candidate. Reachable criteria: every required network step must succeed. An HTTP response below 500 is treated as reachable, including 401 because it confirms that an authenticated API endpoint responded, except for statuses classified as blocked. Blocked results: HTTP 403, 429, 521, 525, and 530, plus detected WAF or Cloudflare challenges, are shown as blocked and excluded from availability calculations because LMSpeed cannot determine whether the API itself is down. Model availability: when a dedicated test key is configured, LMSpeed sends an authenticated GET request to a derived /models endpoint and compares returned model IDs with this provider's listed models. These per-model results appear in Models & Pricing and are not included in the provider connectivity percentage. Timeouts: TCP connection, TLS handshake, HTTP connectivity, and model requests each use a 20-second timeout. A full run can take longer when several candidates are tried. Frequency: a background worker checks all providers every 5 minutes by default. The 72-hour chart combines those samples into hourly bars, and the schedule may be changed by the service operator. Limit: automated samples are not an SLA and do not guarantee account quota, every model, every region, or successful completion requests. Check the provider's own status page before making operational decisions.
  • Domain Rating data is sourced from Ahrefs. It is a 0–100 backlink-based domain strength signal and does not measure API speed or reliability.
  • Announcements and FAQ are read from this provider's NewAPI status snapshot when available. LMSpeed stores the original content and optional English translations from the provider status source, then shows the localized fields on this page.