Show HN: LunarGate – a self-hosted OpenAI-compatible LLM gateway

Category: devtools

Tags: ai-gateway, llm-ops, openai-compatible

Score: 6.5/10 (Innovation: 5, Technical: 6, Documentation: 8, Utility: 7)

LunarGate is a self-hosted, Go-based AI gateway that provides a unified OpenAI-compatible API endpoint for applications while routing requests to various upstream LLM providers like OpenAI, Anthropic, and Ollama. It's interesting because it adds production-grade features like routing, fallback, retries, and circuit breaking to local LLM deployments, enabling a stable interface while the underlying model infrastructure changes.

Target audience: backend devs, devops, ai engineers

Repository: https://github.com/lunargate-ai/gateway · Go · MIT · 10 stars

View on Hacker News