Show HN: Preseason.ai – Open-source benchmark of devtool choices, ranked by LLM

Category: devtools

Tags: benchmark, llm, developer-tools

Score: 7.5/10 (Innovation: 7, Technical: 7, Documentation: 9, Utility: 7)

Preseason.ai is an open-source benchmark that systematically measures which developer tools large language models recommend for building web applications, providing transparent and reproducible rankings. It combines cron-driven prompting of multiple models with strict parsing of tool recommendations, enabling head-to-head comparisons and inspectable methodology. The project is interesting because it addresses the growing influence of AI on developer tool adoption with an open, contestable approach.

Target audience: backend devs

Repository: https://www.preseason.ai · TypeScript · MIT

View on Hacker News