Show HN: Routiium – self-hosted LLM gateway with a tool-result guard

Category: infrastructure

Tags: llm-gateway, ai-security, self-hosted, rust, openai-compatible

Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)

Routiium is a self-hosted LLM gateway that acts as a secure proxy between applications and various LLM providers, adding managed API keys, policy routing, rate limiting, and a built-in safety judge that can detect prompt injections and block unsafe tool results. Its combination of OpenAI-compatible API translation, embedded policy router with multiple modes, and optional remote policy service makes it a practical tool for productionizing LLM access with security guardrails.

Target audience: backend devs, devops, security engineers

Repository: https://github.com/labiium/routiium · Rust · Apache-2.0 · 15 stars

View on Hacker News