graniet / rllm
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆123Updated 2 months ago
Alternatives and similar repositories for rllm:
Users that are interested in rllm are comparing it to the libraries listed below
- A set of Rust macros for working with OpenAI function/tool calls.☆48Updated last year
- A Rust library / binary unifying multiple LLM backends.☆85Updated 2 weeks ago
- Highly optimized GUI automation rust library for controlling the mouse and keyboard, with template matching support.☆158Updated last week
- native OCR for MacOS, Windows, Linux☆164Updated 3 weeks ago
- A very fast Key-Value store in pure rust☆160Updated 2 months ago
- A Rust crate for extracting readable content from web pages.☆171Updated last week
- A lightweight, high-performance text embedding model implemented in Rust.☆61Updated 2 weeks ago
- allms: One Rust Library to rule them aLLMs☆77Updated last month
- Create Kafaka-like things while enjoying low-level programming without external crates☆91Updated last month
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆463Updated this week
- Just like `serde`, but with more exhaustive error reporting capabilities. Designed for public API payloads.☆191Updated last month
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.☆46Updated last week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆61Updated 10 months ago
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama t…☆64Updated last month
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆133Updated 6 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆196Updated 2 months ago
- Template to maintain a rust project running CI/CD with Github Workflows.☆118Updated last week
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆158Updated last month
- Library for doing RAG☆72Updated this week
- ChronoMind: Redefining Vector Intelligence Through Time.☆68Updated this week
- Composable Runtime Blocks 🦀 transactional actors☆108Updated this week
- ☆75Updated 4 months ago
- Model Context Protocol (MCP) CLI server template for Rust☆75Updated 2 weeks ago
- 🦀 🖥️ 🦀☆158Updated 9 months ago
- Run, Build, Share your AI Packs☆128Updated this week
- A high-performance API gateway built with Rust, designed for low-latency request processing. Dakia supports dynamic configuration updates…☆97Updated last month
- A very fast, accurate and wasm ready port of Diff Match Patch in Rust. The diff implementation is based on Myers' diff algorithm.☆36Updated this week
- Visualizing Rust codebases in a few seconds☆179Updated 9 months ago
- Re-imagined approach to application design and architecture☆86Updated last month
- Include your assets statically into your application with a strict structure☆88Updated last month