graniet / rllmLinks
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆138Updated 7 months ago
Alternatives and similar repositories for rllm
Users that are interested in rllm are comparing it to the libraries listed below
Sorting:
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆273Updated this week
- A set of Rust macros for working with OpenAI function/tool calls.☆55Updated last year
- A lightweight, high-performance text embedding model implemented in Rust.☆73Updated 7 months ago
- A Rust crate for extracting readable content from web pages.☆189Updated 2 weeks ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆240Updated 4 months ago
- Run, Build, Share your AI Packs☆166Updated last week
- Tako is a lightweight and minimalistic web framework built on Tokio and Hyper written in Rust.☆114Updated 2 weeks ago
- High-performance framework for building interactive multi-agent workflow systems in Rust☆214Updated 3 weeks ago
- native OCR for MacOS, Windows, Linux☆197Updated 2 months ago
- A new type of asynchronous database combining the concepts of distributed databases and blockchain☆110Updated 3 months ago
- 🦀 🖥️ 🦀☆164Updated last year
- Model Context Protocol (MCP) implementation in Rust☆345Updated 9 months ago
- Model Context Protocol (MCP) CLI server template for Rust☆81Updated 8 months ago
- Userp is a Rust user account system inspired by Next Auth, with OAuth, password and email support, a ready-made Axum router with Askama t…☆66Updated 9 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆628Updated this week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆64Updated last year
- Library for doing RAG☆79Updated last week
- in memory Rust database to query your data like a Venn diagram☆128Updated last month
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆172Updated 6 months ago
- Highly optimized GUI automation rust library for controlling the mouse and keyboard, with template matching support.☆270Updated 2 months ago
- Embedded time-series database for Rust☆195Updated last month
- Llama2 LLM ported to Rust burn☆278Updated last year
- Just like `serde`, but with more exhaustive error reporting capabilities. Designed for public API payloads.☆219Updated 6 months ago
- A high-performance and efficient message queue developed in Rust☆270Updated 10 months ago
- ☆36Updated 8 months ago
- Template to maintain a rust project running CI/CD with Github Workflows.☆135Updated last week
- ChronoMind: Redefining Vector Intelligence Through Time.☆72Updated 7 months ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆138Updated last year
- A very fast Key-Value store in pure rust☆213Updated this week
- Rust Wasm plugins examples☆117Updated 2 weeks ago