graniet / rllm
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆114Updated last month
Alternatives and similar repositories for rllm:
Users that are interested in rllm are comparing it to the libraries listed below
- native OCR for MacOS, Windows, Linux☆153Updated this week
- A Rust library / binary unifying multiple LLM backends.☆64Updated last week
- A Rust crate for extracting readable content from web pages.☆162Updated last week
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆194Updated last month
- A set of Rust macros for working with OpenAI function/tool calls.☆46Updated last year
- Library for doing RAG☆72Updated 3 weeks ago
- Run, Build, Share your AI Packs☆121Updated this week
- Just like `serde`, but with more exhaustive error reporting capabilities. Designed for public API payloads.☆188Updated last month
- A very fast Key-Value store in pure rust☆156Updated last month
- Create Kafaka-like things while enjoying low-level programming without external crates☆91Updated last week
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.☆36Updated last week
- A GUI automation Rust module . Used to programmatically control the mouse & keyboard and for finding image on screen.☆85Updated this week
- Template to maintain a rust project running CI/CD with Github Workflows.☆117Updated 2 weeks ago
- A high-performance API gateway built with Rust, designed for low-latency request processing. Dakia supports dynamic configuration updates…☆95Updated 3 weeks ago
- CRB 🦀 transactional actors☆106Updated this week
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆132Updated 6 months ago
- in memory Rust database to query your data like a Venn diagram☆100Updated 4 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆444Updated this week
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama t…☆65Updated 3 weeks ago
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆157Updated 3 weeks ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆65Updated last week
- 🦀 🖥️ 🦀☆158Updated 8 months ago
- Llama2 LLM ported to Rust burn☆276Updated last year
- A very fast, accurate and wasm ready port of Diff Match Patch in Rust. The diff implementation is based on Myers' diff algorithm.☆33Updated last month
- allms: One Rust Library to rule them aLLMs☆73Updated last month
- Model Context Protocol (MCP) implementation in Rust☆291Updated 3 weeks ago
- ChronoMind: Redefining Vector Intelligence Through Time.☆67Updated 3 months ago
- Low rank adaptation (LoRA) for Candle.☆142Updated 7 months ago
- Distributed stress testing framework in Rust☆115Updated 2 months ago
- Unofficial Rust bindings to Apple's mlx framework☆150Updated last week