Show HN: Routiium 0.3.0 – an LLM gateway with a tool-result guard for agents

Category: infrastructure

Tags: llm-gateway, api-management, safety-judge, rust, openai-compatible

Score: 7.0/10 (Innovation: 6, Technical: 7, Documentation: 8, Utility: 7)

Routiium is a self-hosted, OpenAI-compatible LLM gateway that provides managed API keys, policy routing, safety judging, and rate limiting between applications and model providers. Its interesting combination of deterministic and LLM-based safety checks, tool-result guarding for agents, and built-in routing profiles makes it a practical security layer for AI deployments.

Target audience: backend devs, devops, ml-ops

Repository: https://tomiwao.substack.com/p/put-a-bouncer-in-front-of-your-ai · Rust · Apache-2.0 · 15 stars

View on Hacker News