Show HN: QVAC SDK, a universal JavaScript SDK for building local AI applications

Category: ai-ml

Tags: llm-inference, fine-tuning, mobile-ai, cross-platform, c-plus-plus

Score: 7.3/10 (Innovation: 7, Technical: 8, Documentation: 7, Utility: 7)

QVAC SDK is a specialized fork of llama.cpp optimized for embedded and mobile systems, adding exclusive features like cross-platform LoRA fine-tuning, BitNet inference/training, memory-based model loading, and mobile GPU optimizations. It's interesting because it extends popular local AI infrastructure to resource-constrained environments while maintaining upstream compatibility.

Target audience: mobile developers, embedded engineers, ai researchers, backend devs

Repository: https://github.com/tetherto/qvac-fabric-llm.cpp · C++ · MIT · 86 stars

View on Hacker News