Groq offers AI inference services via its GroqCloud platform, built on the LPU (Language Processing Unit) architecture designed for speed and affordability at scale. Key capabilities include high-performance inference for AI models, with a focus on low latency and cost efficiency. The platform supports developers and enterprises, providing API access for building AI applications. Notable strengths include fast inference speeds and competitive pricing, as highlighted in customer stories and demos. Typical use cases involve AI-powered applications in various industries, such as those demonstrated by partners like McLaren F1 Team, Dropbox, Vercel, and others. The service includes free API keys, documentation, and community support for developers.
Groq provides fast and low-cost AI inference through its LPU architecture and GroqCloud platform.
- Models
- 20 models
- From
- --
- Speed
- 20 tok/s
- Updated
- 7/8/2026
- Latency
- 0.00 s
- Created At
- 12/8/2025
API Endpoints
- Endpoint 1
api.groq.com
Verify ownership to unlock provider management features:
- Edit provider name, content, and links
- Get featured with priority traffic and visibility boost
- Display a verified badge to build user trust
Leaderboard Rankings
Rankings are based on community-submitted tests and periodic health probes. Advisory only, not official data.
About Groq
Health Check
API Benchmarks & Pricing
Compare 20 model rows across audit recency, latest speed tests, throughput, latency, and per-token pricing.
qwen/qwen3.8-27b | - | - |
qwen/qwen3.6-27b | - | - |
allam-2-7b | - | - |
canopylabs/orpheus-arabic-saudi | - | - |
canopylabs/orpheus-v1-english | - | - |
groq/compound | - | - |
groq/compound-mini | - | - |
llama-3.1-8b-instant | - | - |
llama-3.3-70b-versatile | - | - |
meta-llama/llama-4-scout-17b-16e-instruct | 447.8 t/s | 0.20 s |
meta-llama/llama-prompt-guard-2-22m | - | - |
meta-llama/llama-prompt-guard-2-86m | - | - |
openai/gpt-oss-120b | - | - |
openai/gpt-oss-20b | - | - |
openai/gpt-oss-safeguard-20b | - | - |
qwen/qwen3-32b | - | - |
whisper-large-v3 | - | - |
whisper-large-v3-turbo | - | - |
| 19.7 t/s | 25.30 s | |
| 53.0 t/s | 8.89 s |
Showing 20 of 20 model rows
Free resources
Community-shared API keys and redeem codes associated with Groq.
Free API keys
4| API key / Status | API URL | Models | Submitted |
|---|---|---|---|
gsk_nQ***NEXF Available | https://api.groq.com/openai/v1 | openai/gpt-oss-safeguard-20b · whisper-large-v3 · +12 | Dmitry· Aug 2, 2026 |
gsk_lg***2sgD Available | https://api.groq.com/openai/v1 | openai/gpt-oss-20b · meta-llama/llama-prompt-guard-2-86m · +12 | Dmitry· Aug 2, 2026 |
gsk_Jb***M5b4 Available | https://api.groq.com/openai/v1 | openai/gpt-oss-120b · meta-llama/llama-prompt-guard-2-86m · +12 | Dmitry· Aug 2, 2026 |
gsk_RZ***MiW6 Available | https://api.groq.com/openai/v1 | meta-llama/llama-prompt-guard-2-86m · allam-2-7b · +12 | Dmitry· Aug 2, 2026 |
Recent Test Records
| Time | Model | Speed | Latency |
|---|---|---|---|
| Apr 25, 11:32 PM | meta-llama/llama-4-scout-17b-16e-instruct | 447.76 tok/s | 0.20s |
| Dec 23, 03:21 PM | free:Qwen3-30B-A3B | 23.23 tok/s | 18.61s |
| Dec 20, 02:59 AM | free:Qwen3-30B-A3B | 24.49 tok/s | 13.14s |
| Dec 18, 08:29 AM | free:Qwen3-30B-A3B | 30.07 tok/s | 9.45s |
| Dec 18, 04:35 AM | free:Qwen3-30B-A3B | 22.38 tok/s | 27.29s |
| Dec 17, 09:28 AM | free:Qwen3-30B-A3B | 24.97 tok/s | 15.03s |
| Dec 16, 12:22 PM | free:Qwen3-30B-A3B | 21.75 tok/s | 4.61s |
| Dec 16, 07:52 AM | free:Qwen3-30B-A3B | 19.47 tok/s | 23.58s |
| Dec 14, 04:14 PM | free:Qwen3-30B-A3B | 29.29 tok/s | 5.65s |
| Dec 13, 03:57 PM | free:Qwen3-30B-A3B | 21.04 tok/s | 1.45s |
Similar API Provider Alternatives to Compare
Compare Groq alternatives against 6 nearby API providers using 96 LMSpeed signals across shared model coverage, pricing, benchmark speed, uptime, and free-model availability.
| Provider | Why compare | Models | Free | Avg price | Speed | 30d uptime |
|---|---|---|---|---|---|---|
| Groq groq Groq provides fast and low-cost AI inference through its LPU architecture and GroqCloud platform. | Current provider baseline | 20 | 0 | N/A | 20 tok/s | 9670% |
| OpenRouter openrouter A unified API interface providing access to over 300 models from 60+ providers, including OpenAI, Anthropic, and Google. |
| 561 | 0 | N/A | 85 tok/s | 9990% |
| NVIDIA NIM nvidia-nim NVIDIA NIM provides optimized AI model inference APIs for LLMs, vision, and embedding models through NVIDIA cloud infrastructure. |
| 166 | 0 | N/A | 78 tok/s | 9960% |
| 七牛云 qiniu-2 七牛云提供AI大模型推理服务,包括多种模型调用、智能问答助手、代码助手等企业级AI解决方案。 |
| 89 | 0 | N/A | 90 tok/s | 9980% |
| SophNet www-sophnet-com An AI development platform offering API access to models like DeepSeek and Qwen for tasks such as text generation and code creation. |
| 72 | 0 | N/A | 122 tok/s | 9960% |
| SiliconFlow siliconflow Provides cost-effective generative AI cloud services based on open-source models for text, image, video, and audio generation. |
| 154 | 0 | N/A | 59 tok/s | 4340% |
| Novita AI novita-ai Provides a unified API for accessing 200+ AI models, custom model deployment, GPU cloud services, and secure agent sandboxes. |
| 142 | 0 | N/A | 56 tok/s | 6800% |
Notes
- Health checks: Scope: the 72-hour chart and recent availability measure API connectivity only. Each bar summarizes one hour of checks. Targets: LMSpeed tries the configured health check URL and provider status URL first, then API endpoints derived from known API hosts and recent speed-test base URLs. A website host is considered only when it looks like an API endpoint. Probe steps: each candidate goes through DNS lookup, TCP connection, TLS handshake for HTTPS, and an HTTP HEAD request with redirects followed. Probing stops after the first reachable candidate. Reachable criteria: every required network step must succeed. An HTTP response below 500 is treated as reachable, including 401 because it confirms that an authenticated API endpoint responded, except for statuses classified as blocked. Blocked results: HTTP 403, 429, 521, 525, and 530, plus detected WAF or Cloudflare challenges, are shown as blocked and excluded from availability calculations because LMSpeed cannot determine whether the API itself is down. Model availability: when a dedicated test key is configured, LMSpeed sends an authenticated GET request to a derived /models endpoint and compares returned model IDs with this provider's listed models. These per-model results appear in Models & Pricing and are not included in the provider connectivity percentage. Timeouts: TCP connection, TLS handshake, HTTP connectivity, and model requests each use a 20-second timeout. A full run can take longer when several candidates are tried. Frequency: a background worker checks all providers every 5 minutes by default. The 72-hour chart combines those samples into hourly bars, and the schedule may be changed by the service operator. Limit: automated samples are not an SLA and do not guarantee account quota, every model, every region, or successful completion requests. Check the provider's own status page before making operational decisions.
- Domain Rating data is sourced from Ahrefs. It is a 0–100 backlink-based domain strength signal and does not measure API speed or reliability.
- Announcements and FAQ are read from this provider's NewAPI status snapshot when available. LMSpeed stores the original content and optional English translations from the provider status source, then shows the localized fields on this page.

