Show HN: Llmconfig – configfile and CLI for local LLM

Category: cli-tool

Tags: local-llm, cli, yaml-config

Score: 6.0/10 (Innovation: 5, Technical: 6, Documentation: 7, Utility: 6)

Llmconfig is a CLI tool that manages local inference for llama.cpp, stable-diffusion.cpp, and whisper.cpp models using a single YAML config file. It simplifies running multiple AI backends with hardware-aware profiles and an OpenAI-compatible API gateway, making local LLM deployment more accessible.

Target audience: backend devs, data engineers

Repository: https://github.com/kiliczsh/llmconfig · Go · MIT

View on Hacker News