Show HN: Self hosting a modern LLM stack

Category: infrastructure

Tags: self-hosted, llm, rag, vector-database, cli-tool

Score: 7.0/10 (Innovation: 7, Technical: 7, Documentation: 7, Utility: 7)

llmaker is an open-source platform that provisions and manages a complete LLM stack (models, vector databases, embeddings, agents, observability) on your own infrastructure via a single CLI command. It combines multiple tools into a single declarative workflow, offering automatic service discovery, a built-in RAG agent, and observability out of the box, making private LLM applications significantly easier to deploy and operate.

Target audience: backend devs, devops, data engineers

Repository: https://github.com/raiyanyahya/llmaker · Go · NOASSERTION · 46 stars

View on Hacker News