Show HN: Trip – a complete transformer engine in C built from scratch just by me

Category: library

Tags: transformer, c, machine-learning

Score: 7.8/10 (Innovation: 7, Technical: 10, Documentation: 8, Utility: 6)

TRiP is a from-scratch C engine implementing transformer model inference, training, tokenizer building, chat, and vision for architectures like Llama 2, Gemma, and GPT-2. It is notable for its educational focus, full backpropagation with AdamW, and minimal dependencies, all built by one developer over 18 months.

Target audience: backend devs, data engineers, ai-ml researchers

Repository: https://github.com/carlovalenti/TRiP · C · NOASSERTION · 18 stars

View on Hacker News