Show HN: Crawlora-deadweb – tell if a domain is dead or just blocking your bot

Category: other

Tags: domain-checker, dns-probe, cli-tool

Score: 6.3/10 (Innovation: 5, Technical: 6, Documentation: 8, Utility: 6)

Crawlora-deadweb is a CLI tool and Go library that probes domains to classify them as alive, redirect, blocked, or dead, distinguishing genuinely dead domains from those blocking automated clients. Its novel approach corrects common overestimates of web deadness by separating anti-bot blocking from true unavailability, and optionally integrates with a hosted browser-fingerprint engine for deeper analysis.

Target audience: backend devs, devops, data engineers

Repository: https://github.com/Crawlora-org/crawlora-deadweb · Go · MIT

View on Hacker News