graniet / rllm
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
β103Updated 2 weeks ago
Alternatives and similar repositories for rllm:
Users that are interested in rllm are comparing it to the libraries listed below
- A GUI automation Rust module . Used to programmatically control the mouse & keyboard and for finding image on screen.β72Updated 3 weeks ago
- Create Kafaka-like things while enjoying low-level programming without external cratesβ84Updated last month
- CRB π¦ transactional actorsβ104Updated this week
- A set of Rust macros for working with OpenAI function/tool calls.β45Updated 10 months ago
- Library for doing RAGβ68Updated 2 months ago
- Template to maintain a rust project running CI/CD with Github Workflows.β116Updated 2 weeks ago
- A Rust crate for extracting readable content from web pages.β79Updated this week
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesβ174Updated 3 weeks ago
- Embedded Key-Value Storage Engineβ105Updated 2 weeks ago
- A very fast Key-Value store in pure rustβ97Updated this week
- Load testing framework in Rustβ115Updated last week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β54Updated 7 months ago
- ChronoMind: Redefining Vector Intelligence Through Time.β67Updated last month
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama tβ¦β60Updated 3 months ago
- βοΈ|>β |>ββ45Updated 7 months ago
- Visualizing Rust codebases in a few secondsβ169Updated 7 months ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasβ¦β127Updated 4 months ago
- in memory Rust database to query your data like a Venn diagramβ98Updated 2 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rustβ375Updated this week
- Dakia is a cloud native API Gateway designed with developers experience in mind, offering a fully configurable, extensible and programmabβ¦β78Updated last week
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validationβ149Updated 3 weeks ago
- A very fast HTTP Server based on Hyper and Rustβ81Updated last year
- β75Updated last month
- β31Updated 2 months ago
- Ergonomic and precise error handling provided by error sets. Inspired by Zig's error set type.β136Updated last month
- A framework for declarative programming in Rustβ254Updated 2 months ago
- Atomically updatable variants of Arc and Weak for lock-free concurrency.β180Updated 4 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candleβ68Updated 10 months ago
- Unofficial Rust bindings to Apple's mlx frameworkβ122Updated this week