graniet / rllm
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆111Updated 3 weeks ago
Alternatives and similar repositories for rllm:
Users that are interested in rllm are comparing it to the libraries listed below
- A set of Rust macros for working with OpenAI function/tool calls.☆46Updated 11 months ago
- A Rust crate for extracting readable content from web pages.☆131Updated this week
- A GUI automation Rust module . Used to programmatically control the mouse & keyboard and for finding image on screen.☆74Updated this week
- CRB 🦀 transactional actors☆106Updated 2 weeks ago
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama t…☆62Updated this week
- Create Kafaka-like things while enjoying low-level programming without external crates☆90Updated 3 weeks ago
- Library for doing RAG☆70Updated this week
- in memory Rust database to query your data like a Venn diagram☆99Updated 3 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆186Updated last month
- A very fast Key-Value store in pure rust☆99Updated last month
- ChronoMind: Redefining Vector Intelligence Through Time.☆67Updated 2 months ago
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆153Updated last month
- A distributed sliding window rate limiter built with Tokio/Tower☆27Updated 2 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆413Updated this week
- Distributed stress testing framework in Rust☆115Updated last month
- Template to maintain a rust project running CI/CD with Github Workflows.☆116Updated 3 weeks ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆57Updated 8 months ago
- Re-imagined approach to application design and architecture☆86Updated last month
- Run, Build, Share your AI Packs☆102Updated this week
- A high-performance API gateway built with Rust, designed for low-latency request processing. Dakia supports dynamic configuration updates…☆84Updated this week
- A very fast, accurate and wasm ready port of Diff Match Patch in Rust. The diff implementation is based on Myers' diff algorithm.☆33Updated 3 weeks ago
- Hiqlite - highly-available, embeddable, raft-based SQLite + cache☆137Updated this week
- Rust Wasm Plugins Example☆74Updated 2 months ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆128Updated 5 months ago
- ☆75Updated 3 months ago
- ☆115Updated 2 weeks ago