Show HN: RelayFreeLLM – Free AI Gateway with Auto-Failover (Update))

Category: infrastructure

Tags: ai-gateway, llm, openai-compatible

Score: 7.5/10 (Innovation: 7, Technical: 7, Documentation: 8, Utility: 8)

RelayFreeLLM is an open-source AI gateway that aggregates multiple free-tier LLM providers behind a single OpenAI-compatible API with automatic failover. It offers intelligent routing, session affinity, context management, and consistent output normalization, making free AI access more reliable and practical for developers.

Target audience: backend devs

Repository: https://github.com/msmarkgu/RelayFreeLLM · Python · MIT · 77 stars

View on Hacker News