Show HN: Tokid – Token-native IDs for LLM-facing systems

Category: library

Tags: llm, token-optimization, id-format

Score: 6.8/10 (Innovation: 7, Technical: 7, Documentation: 8, Utility: 5)

Tokid is a tokenizer-aware ID format and SDK library designed to reduce LLM token costs when identifiers appear in prompts, tool calls, JSON payloads, logs, or URLs. It offers three renderings (prompt, transport, envelope) optimized for different contexts, backed by multi-language SDKs and a portable manifest system, making it a novel combinatorial approach to an AI-specific pain point.

Target audience: backend devs, ai-engineers, data-engineers

Repository: https://github.com/Tetra-Research/tokid · TypeScript · ISC

View on Hacker News