graniet / rllmLinks
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆138Updated 6 months ago
Alternatives and similar repositories for rllm
Users that are interested in rllm are comparing it to the libraries listed below
Sorting:
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆267Updated 2 weeks ago
- High-performance framework for building interactive multi-agent workflow systems in Rust☆195Updated 2 months ago
- A Rust crate for extracting readable content from web pages.☆183Updated last week
- A lightweight, high-performance text embedding model implemented in Rust.☆72Updated 6 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆55Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆239Updated 3 months ago
- A new type of asynchronous database combining the concepts of distributed databases and blockchain☆110Updated 2 months ago
- native OCR for MacOS, Windows, Linux☆195Updated last month
- Run, Build, Share your AI Packs☆165Updated last week
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.☆71Updated this week
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆172Updated 5 months ago
- Agent2Agent in Rust☆72Updated last week
- Library for doing RAG☆78Updated last week
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆618Updated last week
- Tako is a lightweight and minimalistic web framework built on Tokio and Hyper written in Rust.☆110Updated last week
- Model Context Protocol (MCP) implementation in Rust☆344Updated 8 months ago
- 🦀 🖥️ 🦀☆163Updated last year
- ChronoMind: Redefining Vector Intelligence Through Time.☆71Updated 7 months ago
- Highly optimized GUI automation rust library for controlling the mouse and keyboard, with template matching support.☆263Updated last month
- A high-performance, asynchronous toolkit for building MCP servers and clients in Rust.☆124Updated last week
- in memory Rust database to query your data like a Venn diagram☆125Updated 2 weeks ago
- Embedded time-series database for Rust☆184Updated last week
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama t…☆66Updated 8 months ago
- Llama2 LLM ported to Rust burn☆278Updated last year
- A very fast Key-Value store in pure rust☆213Updated last week
- Rust Wasm plugins examples☆115Updated this week
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆137Updated last year
- Model Context Protocol (MCP) CLI server template for Rust☆81Updated 7 months ago
- An async actor framework for Rust☆58Updated 2 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Updated 9 months ago