Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
☆123Nov 4, 2026Updated this week
Alternatives and similar repositories for litellm-rs
Users that are interested in litellm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rust-native AI coding agent CLI with multi-provider LLM support, Ollama, MCP tools, and resumable sessions☆12Oct 23, 2026Updated 2 weeks ago
- Run fleets of parallel coding agents with governance — Rust control plane for Claude Code & Codex: orchestration, policy, cross-agent rev…☆89Oct 29, 2026Updated last week
- A bounded RAM + SSD cache.☆15Oct 28, 2026Updated last week
- CLI tool wrapping claude code to help understand cost breakdown☆21Jun 27, 2026Updated 4 months ago
- A minimal Rust gateway built for coding agents (LiteLLM-Compatible)☆227Jun 25, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MOVED → github.com/yinnho/diting — same engine, new name. All releases & development live there.☆56Updated this week
- Wukong: a command-line toolchain for Java with Rust☆11Oct 22, 2026Updated 2 weeks ago
- Weixin iLink bot adapter for Chat SDK.☆14Jul 20, 2026Updated 3 months ago
- Rust Based Multi-language Static Analyser & Developer tools for the AI age.☆31Oct 11, 2026Updated 3 weeks ago
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆233Jul 16, 2026Updated 3 months ago
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, ZAI, OpenRouter, FireworksAI, xAI/Grok, Groq,, ...)☆934Updated this week
- Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — rou…☆213Updated this week
- Harn is a programming language and runtime for building AI agents.☆29Updated this week
- A Rust no-std implementation of Zenoh.☆33Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 飞牛第三方应用仓库☆12Updated this week
- High-fidelity time library for Rust, useful for applications where sub-nanosecond accuracy and exact arithmetic are needed☆39Nov 4, 2025Updated last year
- Reusable UI components and widgets built on top of gpui.☆348Updated this week
- Self-hosted AI code review that runs in CI and posts inline comments. 12 AI providers (Claude, GPT-4o, Gemini, Ollama, …), 5 git platform…☆19Aug 7, 2026Updated 2 months ago
- Self-hosted semantic code search platform — Go server with web dashboard, CLI, and AI-agent skills. Search code by meaning, not text: hyb…☆31Updated this week
- OPTIMEO is a web application doubled by a package that helps you optimize your experimental process by generating a Design of Experiment,…☆12Oct 26, 2026Updated last week
- [ICML 2026] NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models☆27Jul 3, 2026Updated 4 months ago
- A distributed search and SQL analytics engine in Rust with Raft consensus, hybrid BM25+vector search, and a search-aware query planner — …☆16Oct 18, 2026Updated 2 weeks ago
- API + AI 融合网关☆57Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Conveniently expose (environment) variables to your serde based data structures, like configurations.☆12Sep 2, 2026Updated 2 months ago
- dozegms☆11Sep 2, 2018Updated 8 years ago
- Beeg float library, a Rust port of Fabrice Bellard's libbf☆22Sep 29, 2026Updated last month
- AI-powered customer support operations platform☆16Updated this week
- OminiX API Server to support LLM, image, ASR and TTS☆35Aug 17, 2026Updated 2 months ago
- A strongly consistent distributed key-value store library built on Raft consensus protocol and RocksDB.☆50Updated this week
- Bayesian decision theory engine for AI agents — Beta posteriors, VOI, and EU maximisation. Foundation for credence-router.☆15Apr 2, 2026Updated 7 months ago
- A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents☆778Oct 18, 2026Updated 2 weeks ago
- Tests CLI behavior from plain YAML: exit codes, output, files, snapshots, and interactive terminals (PTY/TUI)☆18Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Just simple Tauri Shadcn Template based on React / Vite☆14Aug 15, 2024Updated 2 years ago
- A sandboxed execution environment for AI agents. Single Rust binary with browser, shell, code execution, file ops, and MCP server.☆19Jun 8, 2026Updated 4 months ago
- Crow Middleware for Configuring HTTP Security Headers☆10Sep 30, 2015Updated 11 years ago
- Alephant is an open-source AI Agent Gateway for routing, tracking, and controlling LLM usage across AI agents, members, and workflows, an…☆118Updated this week
- Official ServerlessClaw: The authoritative autonomous AI agent swarm for AWS. Zero idle cost, self-evolving, and infinite scale. Powered …☆21Updated this week
- Multi-layer Intelligent Evaluation for Smart Contracts — 50 security tools across 35 analysis modules, 9 defense layers, one command. Pre…☆14Updated this week
- 用 Rust 实现的 QQ 官方机器人框架☆16May 29, 2026Updated 5 months ago