A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format
☆105Jul 21, 2026Updated this week
Alternatives and similar repositories for litellm-rs
Users that are interested in litellm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Haskell bindings to llama.cpp☆12Dec 22, 2023Updated 2 years ago
- A minimal Rust gateway built for coding agents (LiteLLM-Compatible)☆188Jun 25, 2026Updated 3 weeks ago
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, xAI/Grok, Groq,Cohere, ...)☆839Updated this week
- AI-powered application builder built with Next.js 16 that lets you create apps and websites by chatting with AI.☆19Updated this week
- Alephant is an open-source AI Agent Gateway for routing, tracking, and controlling LLM usage across AI agents, members, and workflows, an…☆107Jun 12, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆221Updated this week
- Algorithmic trading bot in Rust with multi-agent architecture, 10 strategies, risk management, and native egui UI. Supports Alpaca & Bina…☆15Jun 13, 2026Updated last month
- A high-performance, open-source Multi-Agent Collaboration Platform built with Tauri, Rust, and SolidJS☆19Jun 7, 2026Updated last month
- 🦀 A self-hosted, multi-agent service framework built in Rust. Agents as services, not scripts.☆15Updated this week
- Run multiple AI coding agents from one terminal dashboard.☆23Updated this week
- Rust implementation of TurboQuant, PolarQuant, and QJL — zero-overhead vector quantization for semantic search and KV cache compression (…☆29May 31, 2026Updated last month
- High-performance Cloudflare bypass library with stealth browser automation. Rust-native with C FFI bindings.☆19Apr 28, 2026Updated 2 months ago
- Arbor — The Agentic RL Sandbox. Checkpoint-native. Branch-safe. Self-hosted.☆15Jun 16, 2026Updated last month
- A type-safe OpenRouter Rust SDK.☆76Jul 14, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distributed market-making system. Avellaneda-Stoikov strategy with sub-microsecond C++ hot-path (431ns), event-sourced architecture, VPIN…☆15Jun 5, 2026Updated last month
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆17May 7, 2026Updated 2 months ago
- A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents☆713Jul 8, 2026Updated last week
- 🛡️ Programmable Guardrails for LLM Applications in Java. A framework-agnostic toolkit for input/output validation, PII masking, and jail…☆17Apr 15, 2026Updated 3 months ago
- Google Gemini API proxy☆12Dec 25, 2023Updated 2 years ago
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆351Updated this week
- MCP proxy that reduces token usage via TOON format☆19Feb 28, 2026Updated 4 months ago
- ☆13May 1, 2026Updated 2 months ago
- VS code extension to analyze angular specific definitions☆12Apr 14, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Agent-first Rust/Axum backend harness for SDD-driven Clean/Hexagonal/DDD services, ECS-style runtime composition, counter-service referen…☆49May 24, 2026Updated last month
- Pure-Rust LLM runtime: one binary serves (OpenAI-compatible), runs local agents, and distills models on their own rollouts — on Apple Sil…☆20Updated this week
- LLaMA2 + Rust☆14Aug 8, 2023Updated 2 years ago
- A language agnostic, easy to use, IPC library for cross-language integration.☆33Updated this week
- Geometric agent memory for Agents: 8-tool lean contract, harness injection at wake, session handoff. 79 MCP tools. Not a vector DB. Rust …☆17Updated this week
- A Haskell library providing low-level functions for SMTLIB-based interaction with SMT solvers.☆19Mar 4, 2026Updated 4 months ago
- A simple csv parser and encoder written in gleam☆19Apr 18, 2026Updated 3 months ago
- Utilities and tools to work with i18n.☆23Oct 22, 2025Updated 9 months ago
- Rust bindings to the Aeron C libraries☆17Jul 11, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)☆10May 31, 2024Updated 2 years ago
- An alternative rust async runtime.☆58Dec 15, 2025Updated 7 months ago
- `agent-spec` is an AI-native BDD/spec verification tool for task execution.☆429Updated this week
- Implementation of semver and NPM-style semantic version ranges in Haskell☆12Apr 8, 2020Updated 6 years ago
- Reusable UI components and widgets built on top of gpui.☆340Updated this week
- hdfs client impl with pure rust☆19Jan 9, 2024Updated 2 years ago
- A secure, stable Rust alternative to openclaw/moltbot/clawdbot☆47Updated this week