graniet / rllmLinks
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆132Updated 2 months ago
Alternatives and similar repositories for rllm
Users that are interested in rllm are comparing it to the libraries listed below
Sorting:
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆156Updated last week
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆219Updated last week
- A set of Rust macros for working with OpenAI function/tool calls.☆50Updated last year
- High-performance framework for building interactive multi-agent workflow systems in Rust☆111Updated this week
- A lightweight, high-performance text embedding model implemented in Rust.☆66Updated 2 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆525Updated this week
- native OCR for MacOS, Windows, Linux☆183Updated last week
- A Rust crate for extracting readable content from web pages.☆174Updated this week
- Library for doing RAG☆74Updated last week
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆167Updated last month
- Create Kafaka-like things while enjoying low-level programming without external crates☆92Updated 2 months ago
- Model Context Protocol (MCP) implementation in Rust☆337Updated 4 months ago
- Highly optimized GUI automation rust library for controlling the mouse and keyboard, with template matching support.☆212Updated last week
- Run, Build, Share your AI Packs☆151Updated this week
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆134Updated 9 months ago
- in memory Rust database to query your data like a Venn diagram☆110Updated 8 months ago
- Tako is a lightweight and minimalistic web framework built on Tokio and Hyper written in Rust.☆72Updated this week
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama t…☆65Updated 4 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆92Updated this week
- Distributed stress testing framework in Rust☆116Updated 5 months ago
- Just like `serde`, but with more exhaustive error reporting capabilities. Designed for public API payloads.☆203Updated last month
- A high-performance and efficient message queue developed in Rust☆250Updated 5 months ago
- Template to maintain a rust project running CI/CD with Github Workflows.☆125Updated last month
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.☆63Updated last week
- A high-performance API gateway built with Rust, designed for low-latency request processing. Dakia supports dynamic configuration updates…☆99Updated 4 months ago
- Model Context Protocol (MCP) CLI server template for Rust☆78Updated 3 months ago
- 🦀 🖥️ 🦀☆161Updated 11 months ago
- A high-performance, asynchronous toolkit for building MCP servers and clients in Rust.☆75Updated 3 weeks ago
- Unofficial Rust bindings to Apple's mlx framework☆173Updated this week
- A very fast Key-Value store in pure rust☆208Updated 3 weeks ago