Show HN: Find the best local LLM for your hardware, ranked by benchmarks

Category: devtools

Tags: llm, benchmarking, hardware-detection, cli-tool, huggingface, python

Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)

whichllm is a CLI tool that auto-detects your hardware and ranks the best local LLMs from HuggingFace based on real benchmarks, VRAM fit, and speed. Its innovative approach combines live benchmark data with confidence-weighted scoring and recency awareness, solving the gap between 'what fits' and 'what's actually best' for local AI deployment.

Target audience: backend devs, devops, data engineers, AI enthusiasts

Repository: https://github.com/Andyyyy64/whichllm · Python · MIT · 19 stars

View on Hacker News