Verified project record

tashfeenahmed/freellmapi

freellmapi aggregates free tiers from 29 LLM providers including Google, Groq, and Mistral behind a single OpenAI-compatible /v1 endpoint with smart routing, automatic failover, and encrypted key storage. It provides a React admin dashboard and client setup generators for coding agents such as Claude Code, Cursor, and Aider.

Project overview

By consolidating 29 providers and 251 model families behind one OpenAI-compatible proxy with AES-256-GCM encrypted key management and automatic failover on 429/5xx errors, freellmapi eliminates the manual complexity of juggling disparate SDKs, rate limits, and failure points across free-tier LLM services.

Project type: Infrastructure
Deployment: Refer to project documentation
License: MIT

Best for

Developers seeking to consolidate free tiers from 29 LLM providers behind a single OpenAI-compatible endpoint for personal experimentation and learning
Developers who want automatic failover and key rotation across providers without writing per-provider integration code

Key capabilities

Aggregates free tiers from multiple providers behind a single OpenAI-compatible /v1 API endpoint with smart routing.
Retries the next provider or model automatically on 429/5xx errors with cooldowns and key rotation.
Stores provider keys encrypted using AES-256-GCM in SQLite and exposes a single unified bearer token to apps.
React UI to manage keys, reorder the fallback chain, run a playground, and read p50/p95/TTFT analytics.
Generators that fetch your live catalog, back up existing config, and set up various coding agents.

Limitations and risks

The aggregated free-tier catalog does not include frontier models.
Latency varies across requests depending on which provider and model serves each request.
No service-level agreement is provided.
The project is explicitly intended for personal experimentation and learning, not for production use.
Users must comply with the Terms of Service of each upstream LLM provider whose free tier they route through the proxy.

Getting started

Run curl -fsSL https://freellmapi.co/install.sh | bash to install, then open http://localhost:3001 in a browser. Add provider keys in the dashboard and retrieve the unified API key. Pre-built desktop binaries are also available for the desktop app, which requires no account or password to set up.

Evidence and sources

Open original GitHub project