Show HN: I ported 11 model families to Apple's new on-device AI framework

Category: library

Tags: apple-core-ai, on-device-ai, llm-conversion, swift, model-zoo

Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)

This project ports 11 model families to Apple's new Core AI framework for on-device inference, providing downloadable models, conversion scripts, and a Swift runtime. It's interesting because it enables running large language and vision models locally on iPhones with competitive throughput, bridging the gap between proprietary Apple hardware and open-source AI.

Target audience: iOS/macOS developers, AI researchers, machine learning engineers

Repository: https://github.com/john-rocky/coreai-model-zoo · Swift · NOASSERTION · 47 stars

View on Hacker News