Show HN: Otari: your open-source LLM control plane

Category: infrastructure

Tags: llm-gateway, proxy-server, openai-compatible

Score: 6.3/10 (Innovation: 5, Technical: 6, Documentation: 7, Utility: 7)

Otari is an open-source LLM gateway proxy from Mozilla that provides a unified OpenAI-compatible endpoint for over 40 LLM providers, enabling centralized API key management, budget enforcement, and usage tracking. It is interesting because it combines cost control, multi-provider routing, and self-hosted privacy in a single tool, backed by Mozilla's credibility.

Target audience: backend devs, devops, ai engineers

Repository: https://github.com/mozilla-ai/otari · Python · Apache-2.0 · 72 stars

View on Hacker News