graniet / rllmLinks
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆139Updated 7 months ago
Alternatives and similar repositories for rllm
Users that are interested in rllm are comparing it to the libraries listed below
Sorting:
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆279Updated this week
- A set of Rust macros for working with OpenAI function/tool calls.☆55Updated last year
- A Rust crate for extracting readable content from web pages.☆189Updated last week
- A lightweight, high-performance text embedding model implemented in Rust.☆73Updated 8 months ago
- 🦀 🖥️ 🦀☆165Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆239Updated 5 months ago
- High-performance framework for building interactive multi-agent workflow systems in Rust☆225Updated last month
- native OCR for MacOS, Windows, Linux☆196Updated 3 months ago
- A new type of asynchronous database combining the concepts of distributed databases and blockchain☆111Updated 3 months ago
- Tako is a lightweight and minimalistic web framework built on Tokio and Hyper written in Rust.☆133Updated this week
- Run, Build, Share your AI Packs☆170Updated this week
- High performance embedded vector database☆162Updated 3 weeks ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆641Updated this week
- Compile-time state machine magic for Rust: Zero-boilerplate typestate patterns with automatic transition validation☆172Updated 7 months ago
- Model Context Protocol (MCP) implementation in Rust☆349Updated 9 months ago
- 🦀 Prevents outdated Rust code suggestions from AI assistants. This MCP server fetches current crate docs, uses embeddings/LLMs, and prov…☆240Updated last month
- Highly optimized GUI automation rust library for controlling the mouse and keyboard, with template matching support.☆277Updated 2 months ago
- Agent2Agent in Rust☆75Updated last month
- Model Context Protocol (MCP) CLI server template for Rust☆81Updated 9 months ago
- Library for doing RAG☆81Updated 2 weeks ago
- Embedded time-series database for Rust☆203Updated this week
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.☆72Updated 2 weeks ago
- A high-performance, asynchronous toolkit for building MCP servers and clients in Rust.☆138Updated 2 weeks ago
- A high-performance and efficient message queue developed in Rust☆270Updated 11 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆111Updated last month
- in memory Rust database to query your data like a Venn diagram☆130Updated 2 months ago
- Rust SDK for the Model Context Protocol (MCP)☆132Updated 6 months ago
- Llama2 LLM ported to Rust burn☆280Updated last year
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆139Updated last year
- Rust Wasm plugins examples☆120Updated last month