Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module
Category: infrastructure
Tags: llm-router, reverse-proxy, nixos, openai-compatible, go
Score: 7.0/10 (Innovation: 6, Technical: 7, Documentation: 8, Utility: 7)
LLMhop is a tiny, stateless HTTP router that routes OpenAI-compatible LLM requests to the appropriate backend based on the model field, designed for single-model inference servers like vLLM and sglang. Its NixOS module with hardened sandboxing and optional backend management makes it a practical, infrastructure-focused solution for consolidating multiple LLM endpoints. The project is interesting for its clean, dependency-free Go implementation and deep integration with NixOS security features.
Target audience: devops, backend devs, platform engineers
Repository: https://github.com/mirkolenz/llmhop · Nix · MIT · 2 stars
View on Hacker News