Catalog/ № 022
Groq
shipUltra-fast inference on custom LPU hardware — open models at 500+ tok/s.
groq.comVerified 2026-08-15
ledger entry · observed by @whysanesanders
Speed that is a feature, not a benchmark: sub-second responses change what UX you can build — voice agents, autocomplete, real-time tools. The free tier is generous enough to build on.
Known limitations
- Model catalog limited to what fits their hardware.
- Context windows capped below the biggest hosted rivals.
- Free-tier throughput limits are tight for production.
Facts
- pricing
- freemium1
- price note
- free tier; from $0.05/1M tokens (small models)
- free tier
- yes
- open source
- no
- api
- yes
- self-host
- no
- category
- dev-infra
Models used
Sources
If we can't show the source, we don't print the number.
Same shelf — dev-infra
Fireworks AI
dev-infra
Fast inference platform for open models — serverless and on-demand GPUs.
APIFREE TIER
freemium$1 starter credits; serverless from $0.10/1M tokens; on-demand GPU from $7/hr
Hugging Face
dev-infra
The GitHub of AI — models, datasets, Spaces and inference endpoints.
APIFREE TIER
freemiumfree; PRO $9/mo; inference pay-as-you-go
OpenRouterfeatured
dev-infra
One API for every major model — unified billing, fallbacks and routing.
APIFREE TIER
freemiumpay-per-token pass-through plus a small fee