Show HN: Wyolet Relay – high throughput, open source LLM router

Category: infrastructure

Tags: llm-router, api-gateway, ai-infrastructure

Score: 6.8/10 (Innovation: 6, Technical: 6, Documentation: 8, Utility: 7)

Wyolet Relay is an open-source LLM router that provides a unified API endpoint for multiple LLM providers, enabling key pooling, failover, rate limiting, and cost tracking. It stands out for its self-hosted, scalable architecture and extensive feature set aimed at production AI workloads.

Target audience: backend devs, devops, data engineers

Repository: https://github.com/wyolet/relay · Go · Apache-2.0

View on Hacker News