Show HN: Built AI-Gateway reverse proxy to reduce LLM API costs and token burn

Category: infrastructure

Tags: ai-gateway, llm-caching, reverse-proxy

Score: 7.0/10 (Innovation: 6, Technical: 7, Documentation: 8, Utility: 7)

An AI gateway reverse proxy that reduces LLM API costs by caching semantically similar queries. It offers multi-tier matching, Redis support, and zero-code integration, making it a practical cost-saver for AI applications.

Target audience: backend devs

Repository: https://github.com/Arnab758/ai-gateway · Go · 3 stars

View on Hacker News