Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
☆120Oct 15, 2026Updated this week
Alternatives and similar repositories for litellm-rs
Users that are interested in litellm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Haskell bindings to llama.cpp☆12Dec 22, 2023Updated 2 years ago
- A minimal Rust gateway built for coding agents (LiteLLM-Compatible)☆225Jun 25, 2026Updated 3 months ago
- Local-first persistent memory for Claude Code & Codex CLI - Rust CLI, hooks, MCP server, SQLite/SQLCipher, auditable recall for long-runn…☆33Updated this week
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, ZAI, OpenRouter, FireworksAI, xAI/Grok, Groq,, ...)☆907Updated this week
- AI-powered application builder built with Next.js 16 that lets you create apps and websites by chatting with AI.☆23Oct 9, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Alephant is an open-source AI Agent Gateway for routing, tracking, and controlling LLM usage across AI agents, members, and workflows, an…☆114Jun 12, 2026Updated 4 months ago
- API + AI 融合网关☆55Updated this week
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆231Jul 16, 2026Updated 3 months ago
- Github Html Preview Extension In Chrome☆24Sep 6, 2026Updated last month
- A high-performance, open-source Multi-Agent Collaboration Platform built with Tauri, Rust, and SolidJS☆25Oct 7, 2026Updated last week
- AI-powered autonomous equity research agent. Multi-source analysis (Yahoo Finance, SEC 10-K, Reddit, news) with LangGraph orchestration, …☆19May 1, 2026Updated 5 months ago
- High-fidelity time library for Rust, useful for applications where sub-nanosecond accuracy and exact arithmetic are needed☆39Nov 4, 2025Updated 11 months ago
- 🦀 A self-hosted, multi-agent service framework built in Rust. Agents as services, not scripts.☆14Jul 15, 2026Updated 3 months ago
- Self-hosted functional language with explicit effects. Compiles to JVM bytecode, C, and NVIDIA GPU kernels via cuTile.☆153Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ReifyDB is a database for application state☆16Updated this week
- AI-driven CLI for documenting database schemas. DB + docs + codebase agents, 10 backends, BYO LLM, human-in-the-loop review.☆16Aug 31, 2026Updated last month
- Open-source options gamma exposure (GEX) & positioning dashboard — dealer GEX, max pain, open interest, IV surface. Self-hosted, Docker, …☆85Updated this week
- Logging feature for ktor☆10Jan 16, 2022Updated 4 years ago
- Experimental Rust vector-compression sidecars implementing TurboQuant (ICLR 2026), PolarQuant and QJL research primitives, with exact rer…☆26Sep 30, 2026Updated 2 weeks ago
- 📦 Tauri app for monitoring your `node_modules` size and clean them up.☆18Aug 30, 2024Updated 2 years ago
- Arbor — The Agentic RL Sandbox. Checkpoint-native. Branch-safe. Self-hosted.☆14Jun 16, 2026Updated 4 months ago
- A type-safe OpenRouter Rust SDK.☆97Updated this week
- 🛡️ Programmable Guardrails for LLM Applications in Java. A framework-agnostic toolkit for input/output validation, PII masking, and jail…☆16Apr 15, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents☆762Aug 26, 2026Updated last month
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 5 months ago
- Google Gemini API proxy☆12Dec 25, 2023Updated 2 years ago
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆381Sep 7, 2026Updated last month
- An alternative rust async runtime.☆58Dec 15, 2025Updated 10 months ago
- ☆13May 1, 2026Updated 5 months ago
- Open-source AI agent auditor. Know what your agents do before production.☆25Jun 10, 2026Updated 4 months ago
- Probabilistic programming with vectorized programmable inference☆27Sep 27, 2026Updated 2 weeks ago
- Agent-first Rust/Axum backend harness for SDD-driven Clean/Hexagonal/DDD services, ECS-style runtime composition, counter-service referen…☆50May 24, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The local inference server for coding agents. Pure Rust, one binary, Apple Silicon + NVIDIA. Anthropic + OpenAI APIs; the KV cache surviv…☆19Oct 1, 2026Updated 2 weeks ago
- Multi-Agent works on native GUI desktop. Supports skills and IM channel, build-in a IDE for light development. Built on the shared piscis…☆49Jun 16, 2026Updated 4 months ago
- A language agnostic, easy to use, IPC library for cross-language integration.☆46Oct 9, 2026Updated last week
- A Rust SDK for building AI agents with multi-provider LLM support.☆59Mar 25, 2026Updated 6 months ago
- pistachio is a declarative schema management tool for PostgreSQL with a Terraform-like plan/apply workflow.☆60Updated this week
- Kotlin library for shuffling lists too big for memory or for ID obfuscation. Using bijective integer permutations with fast cycle-walking…☆23Sep 6, 2026Updated last month
- Self-hosted S3 storage browser with cost intelligence, optimization recommendations, and AI-powered analytics. Works with AWS, MinIO, R2,…☆33Sep 12, 2026Updated last month