A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format
☆114Sep 16, 2026Updated last week
Alternatives and similar repositories for litellm-rs
Users that are interested in litellm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run fleets of parallel coding agents with governance — Rust control plane for Claude Code & Codex: orchestration, policy, cross-agent rev…☆74Updated this week
- Haskell bindings to llama.cpp☆12Dec 22, 2023Updated 2 years ago
- A minimal Rust gateway built for coding agents (LiteLLM-Compatible)☆212Jun 25, 2026Updated 2 months ago
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 3 years ago
- Local-first persistent memory for Claude Code & Codex CLI - Rust CLI, hooks, MCP server, SQLite/SQLCipher, auditable recall for long-runn…☆32Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, ZAI, OpenRouter, FireworksAI, xAI/Grok, Groq,, ...)☆890Sep 16, 2026Updated last week
- The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc…☆94Updated this week
- Memory-safe clean-room Redis reimplementation in Rust with strict/hardened compatibility modes, deterministic replication semantics, diff…☆27Updated this week
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆228Jul 16, 2026Updated 2 months ago
- Algorithmic trading bot in Rust with multi-agent architecture, 10 strategies, risk management, and native egui UI. Supports Alpaca & Bina…☆14Jun 13, 2026Updated 3 months ago
- 🦀 rtoon is the official Rust implementation of the Token-Oriented Object Notation (TOON) — a compact, human-readable, token-efficient f…☆19Nov 3, 2025Updated 10 months ago
- Github Html Preview Extension In Chrome☆23Sep 6, 2026Updated 2 weeks ago
- A high-performance, open-source Multi-Agent Collaboration Platform built with Tauri, Rust, and SolidJS☆25Jun 7, 2026Updated 3 months ago
- AI-powered autonomous equity research agent. Multi-source analysis (Yahoo Finance, SEC 10-K, Reddit, news) with LangGraph orchestration, …☆19May 1, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 🦀 A self-hosted, multi-agent service framework built in Rust. Agents as services, not scripts.☆14Jul 15, 2026Updated 2 months ago
- Run multiple AI coding agents from one terminal dashboard.☆25Sep 12, 2026Updated last week
- ☆23Sep 7, 2026Updated 2 weeks ago
- Universal LLM API client — 163 providers, 14 native language bindings, powered by a Rust core☆255Updated this week
- Self-hosted functional language with explicit effects. Compiles to JVM bytecode, C, and NVIDIA GPU kernels via cuTile.☆154Updated this week
- Logging feature for ktor☆10Jan 16, 2022Updated 4 years ago
- 📦 Tauri app for monitoring your `node_modules` size and clean them up.☆18Aug 30, 2024Updated 2 years ago
- Arbor — The Agentic RL Sandbox. Checkpoint-native. Branch-safe. Self-hosted.☆14Jun 16, 2026Updated 3 months ago
- Distributed market-making system. Avellaneda-Stoikov strategy with sub-microsecond C++ hot-path (431ns), event-sourced architecture, VPIN…☆15Jun 5, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A type-safe OpenRouter Rust SDK.☆88Sep 8, 2026Updated 2 weeks ago
- PawFlow (Platform for Agentic Workflows) Self-hosted agent runtime for real infrastructure. Run durable AI agents against your own files,…☆25Updated this week
- A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents☆757Aug 26, 2026Updated 3 weeks ago
- 🛡️ Programmable Guardrails for LLM Applications in Java. A framework-agnostic toolkit for input/output validation, PII masking, and jail…☆16Apr 15, 2026Updated 5 months ago
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 4 months ago
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆25Mar 21, 2026Updated 6 months ago
- Google Gemini API proxy☆12Dec 25, 2023Updated 2 years ago
- An alternative rust async runtime.☆58Dec 15, 2025Updated 9 months ago
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆375Sep 7, 2026Updated 2 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆13May 1, 2026Updated 4 months ago
- An open source deep learning library for Unity.☆16Sep 13, 2026Updated last week
- Resize observer hooks for Dioxus 🧬☆13Dec 15, 2024Updated last year
- Probabilistic programming with vectorized programmable inference☆25Aug 31, 2026Updated 3 weeks ago
- LLaMA2 + Rust☆14Aug 8, 2023Updated 3 years ago
- Multi-Agent works on native GUI desktop. Supports skills and IM channel, build-in a IDE for light development. Built on the shared piscis…☆48Jun 16, 2026Updated 3 months ago
- The local inference server for coding agents. Pure Rust, one binary, Apple Silicon + NVIDIA. Anthropic + OpenAI APIs; the KV cache surviv…☆19Sep 13, 2026Updated last week