Show HN: Rustgate – Bypassing Python's event loop for token-aware rate limiting

Category: infrastructure

Tags: rate-limiting, ai-infrastructure, rust-python-bridge

Score: 6.3/10 (Innovation: 6, Technical: 7, Documentation: 6, Utility: 6)

Rustgate is a FastAPI backend with a Rust pyo3 extension that implements token-aware rate limiting for AI model APIs using a sliding window and cost factors per model family. Its integration of token counting via tiktoken-rs with Redis-backed rate limiting in a Rust Python extension is a practical and performant approach to a common AI infrastructure problem.

Target audience: backend devs, AI engineers, devops

Repository: https://github.com/MordechaiHadad/rustgate · Rust · GPL-3.0 · 2 stars

View on Hacker News