Show HN: Sketchlog – 100M events compressed to 93 KB using streaming sketches

Category: library

Tags: probabilistic-data-structures, streaming-metrics, constant-memory

Score: 8.0/10 (Innovation: 8, Technical: 8, Documentation: 9, Utility: 7)

Sketchlog is a Python library that compresses streaming event data into constant-size probabilistic sketches (93 KB), enabling p99 latency, cardinality, and frequency queries without storing raw events. It innovatively combines DDSketch, HyperLogLog, and Count-Min Sketch into a single import with merge algebra and windowed drift detection, making it interesting for high-scale metrics where traditional systems explode memory costs.

Target audience: backend devs, devops, data engineers

Repository: https://github.com/SBALAVIGNESH123/sketchlog · Python · MIT · 4 stars

View on Hacker News