Show HN: Forge – Guardrails take an 8B model from 53% to 99% on agentic tasks

Category: library

Tags: llm, guardrails, tool-calling

Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)

Forge is a guardrail layer for self-hosted LLMs that dramatically improves agentic task reliability via rescue parsing, retry nudges, and context management. Its innovative combination of composable middleware, a proxy server, and priority-queued slot access brings production-grade robustness to local models like Ministral-3 8B.

Target audience: backend devs, devops, data engineers

Repository: https://github.com/antoinezambelli/forge · Python · MIT · 1 stars

View on Hacker News