Show HN: Llama-dash – local LLM operators dashboard and proxy

Category: infrastructure

Tags: ai-gateway, llm-proxy, observability

Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)

Llama-dash is an observable AI gateway and dashboard for self-hosted LLMs, providing proxy, auth, logging, routing, and GPU monitoring in one UI. It uniquely combines policy enforcement with a pluggable backend facade, making local AI infrastructure accessible and manageable for teams.

Target audience: backend devs, devops, data engineers

Repository: https://github.com/ndom91/llama-dash · TypeScript · MIT · 4 stars

View on Hacker News