r/LLMDevs•
SyEhR2

I pooled 16 free LLM API tiers behind one OpenAI endpoint (keyless to start, MIT)

Tools

If you juggle free tiers (Groq, Cerebras, NVIDIA, OpenRouter, Gemini, Cloudflare, …), this might save you some glue code. freellmpool routes each request to a provider you have access to, fails over on 429/down, and tracks per-day usage so you spread load across tiers. pip install freellmpool; two providers are keyless so it works with zero setup. CLI + Python library + an OpenAI/Anthropic proxy (so your existing apps and coding agents work unchanged) + an MCP server.

Not a replacement for a local model or a frontier API — it's for squeezing the free hosted tiers. Limits reset daily; the models are small. MIT, feedback welcome.

https://github.com/0xzr/freellmpool

Posted Jun 4, 2026, 1:00 AM UTC

86
Loading comments…