Show HN: Busbar – every LLM behind one URL, in a single Rust binary

Category: infrastructure

Tags: llm-gateway, rust, ai-proxy, failover, circuit-breaker

Score: 8.0/10 (Innovation: 7, Technical: 9, Documentation: 8, Utility: 8)

Busbar is a unified Rust binary that provides a single OpenAI-compatible endpoint to route requests to multiple LLM vendors with weighted load balancing, circuit breaking, and mid-request failover. Its lossless protocol translation, sophisticated reliability primitives, and static binary deployment make it a novel approach to vendor-agnostic LLM access.

Target audience: backend devs, devops, ML engineers

Repository: https://github.com/MattJackson/busbarAI · Rust · AGPL-3.0

View on Hacker News