Show HN: Ollama-client-rs, a Rust client for Ollama

Category: library

Tags: rust, api-client, llm, ollama, async

Score: 5.5/10 (Innovation: 3, Technical: 6, Documentation: 7, Utility: 6)

A Rust client library for the Ollama API, providing async-first and optional blocking interfaces for all 14 Ollama endpoints including chat, generate, embeddings, and model management. It's interesting because it offers a well-structured, idiomatic Rust wrapper for a popular local LLM runner, with streaming support via NDJSON and an included CLI chat REPL.

Target audience: backend devs, ai-ml engineers

Repository: https://github.com/anperrone/ollama-client-rs · Rust

View on Hacker News