Show HN: Piqc – An open-source GPU waste scanner for LLM inference clusters
Category: infrastructure
Tags: gpu-optimization, kubernetes, llm-inference, cost-optimization, waste-scanner
Score: 7.5/10 (Innovation: 7, Technical: 7, Documentation: 8, Utility: 8)
Piqc is an open-source, read-only GPU waste scanner for Kubernetes clusters running LLM inference workloads. It detects idle GPU allocations, tier misplacement, and dark capacity, surfacing a dollar estimate of waste in under a minute. Its unique value lies in combining multiple waste analysis types (idle, tier mismatch, dark capacity) with a simple, non-invasive deployment as a Kubernetes job.
Target audience: devops, platform engineers, ml-ops, infrastructure engineers
Repository: https://github.com/paralleliq/piqc · Python · NOASSERTION · 8 stars
View on Hacker News