Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
☆139May 20, 2025Updated last year
Alternatives and similar repositories for rllm
Users that are interested in rllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆356Jun 6, 2026Updated last month
- ☆19Jun 18, 2026Updated 2 weeks ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Feb 18, 2025Updated last year
- A worker pool library for Rust☆13Jun 19, 2026Updated 2 weeks ago
- A Rust 🦀 port of the Hugging Face smolagents library.☆43Mar 26, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Minimal example of using Tonic for client/server gRPC☆43Feb 9, 2025Updated last year
- An async actor framework for Rust☆65Apr 23, 2026Updated 2 months ago
- Derive macro to map between different types☆36Jun 15, 2026Updated 3 weeks ago
- AI powered tool for Git commit message generator☆12Jul 29, 2025Updated 11 months ago
- rust crate of tools, algorithms, and structs common to a broad variety of games☆37May 28, 2026Updated last month
- ☆42Jan 15, 2026Updated 5 months ago
- A simple, light wight, composable and extensible scheduler for every runtime.☆31Mar 17, 2025Updated last year
- Model Context Protocol (MCP) implementation in Rust☆349Mar 21, 2025Updated last year
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆712Jul 1, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This crate implements runtime-agnostic driver for async timers and scheduled tasks.☆57Jun 6, 2026Updated last month
- native OCR for MacOS, Windows, Linux☆224Oct 18, 2025Updated 8 months ago
- A chat-room like messaging app, built in pure rust.☆55Apr 14, 2025Updated last year
- ☆14Jun 21, 2026Updated 2 weeks ago
- Plotlars is a Rust library designed to facilitate the integration between the Polars data analysis library and Plotly library.☆658Jun 27, 2026Updated last week
- rustchinaconf2024-slides☆16Sep 15, 2024Updated last year
- Furnace is a high-performance quantitative trading library that provides features similar to CCXT, allowing developers to connect and int…☆16Jan 16, 2025Updated last year
- Typed OpenAI Chat Completions in Rust☆30Jun 28, 2026Updated last week
- Mock REST APIs from JSON with zero coding within seconds.☆37Feb 2, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Rust library that provides filetype glyphs (icons) for a wide range of common file formats.☆36Dec 28, 2024Updated last year
- The official Rust SDK for the Model Context Protocol☆3,595Updated this week
- ☆11Mar 24, 2021Updated 5 years ago
- High-performance, Rust-based asynchronous task programming framework implementing Flow-Based Programming for scalable directed acyclic gr…☆481Jan 16, 2026Updated 5 months ago
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆7,839Updated this week
- Provides a composable, declarative way to consume an iterator.☆25Jun 30, 2026Updated last week
- 🌊 A stateless CSRF middleware for tower.☆35Apr 23, 2026Updated 2 months ago
- rbdc-mcp-server☆24Jun 21, 2026Updated 2 weeks ago
- This project is a web-based LLM (Large Language Model) chat tool developed using Rust, the Dioxus framework, and the Candle framework. It…☆102Aug 3, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🎖️🎨 Instantly create custom badges for GitHub, docs, and more. Lightweight, self-hostable, with live integrations that keep badges alwa…☆44Jun 1, 2026Updated last month
- Rust implementation of Ultralytics YOLOv8/v10 using ONNX (ort)☆38Mar 5, 2026Updated 4 months ago
- A cargo subcommand to bundle a Rust project into a single file ✨☆18Jan 15, 2025Updated last year
- A process monitoring tool that helps you track and analyze specific processes in real-time.☆16Jan 31, 2025Updated last year
- Yolov3 & Yolov4 with TVM and rust☆18Sep 25, 2020Updated 5 years ago
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆310Mar 8, 2026Updated 4 months ago
- make this repo most starred, please 🙏☆12Dec 27, 2024Updated last year