Show HN: "Be horse." – a diffusion language model on an M2 Air

Category: ai-ml

Tags: diffusion-model, language-model, pytorch

Score: 4.0/10 (Innovation: 4, Technical: 5, Documentation: 4, Utility: 3)

This project implements a diffusion language model in PyTorch, trained on a small character-level dataset like Shakespeare. It explores an alternative to autoregressive text generation by using parallel denoising, which is an interesting but incremental approach with limited practical utility.

Target audience: machine learning researchers and hobbyists

Repository: https://boesch.dev/posts/simple-dlm/ · Python · 12 stars

View on Hacker News