Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module
Category: infrastructure
Tags: llm-router, openai-compatible, nixos-module
Score: 6.3/10 (Innovation: 5, Technical: 6, Documentation: 8, Utility: 6)
LLMhop is a stateless HTTP router that maps OpenAI-compatible model names to their corresponding inference backends, enabling a single endpoint to serve multiple LLMs. Its use of pure Go with zero dependencies, secret expansion at startup, and NixOS integration for managing isolated GPU-accelerated workers makes it a pragmatic solution for self-hosted LLM deployment.
Target audience: backend devs, devops
Repository: https://github.com/mirkolenz/llmhop · Nix · MIT · 2 stars
View on Hacker News