Show HN: ARouter – drop-in OpenAI/Anthropic proxy that cuts cost and fails over

Category: infrastructure

Tags: llm-proxy, openai, anthropic, routing, rust

Score: 8.0/10 (Innovation: 7, Technical: 8, Documentation: 9, Utility: 8)

ARouter is a drop-in LLM routing proxy that sits between your application and OpenAI/Anthropic APIs, enabling cost optimization, failover, and validation without code changes. Written in Rust, it translates between wire formats and supports policy-based routing, making it a practical tool for managing LLM costs and reliability in production.

Target audience: backend devs, devops, ml-engineers

Repository: https://github.com/sricola/arouter · Rust

View on Hacker News