Show HN: HN-fdw – All of Hacker News, queryable from Postgres, with zero copies

Category: database

Tags: postgres, data-engineering, foreign-data-wrapper, parquet, hacker-news

Score: 7.5/10 (Innovation: 8, Technical: 7, Documentation: 9, Utility: 6)

This project provides the entire Hacker News dataset as queryable foreign tables in PostgreSQL, using DuckDB and Parquet files from Hugging Face with zero local data copying. It's interesting because it cleverly combines existing technologies (Postgres FDW, DuckDB, HTTPFS, Parquet) to enable instant, on-demand SQL analytics over a massive public dataset without any ETL.

Target audience: data engineers, backend devs, devops

Repository: https://github.com/tamnd/hn-fdw · Python · MIT

View on Hacker News