LLMRouter: An Open-Source Library for LLM Routing
☆3,065Oct 19, 2026Updated 2 weeks ago
Alternatives and similar repositories for LLMRouter
Users that are interested in LLMRouter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,681Aug 10, 2024Updated 2 years ago
- [NeurIPS'25] Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learning☆155Dec 30, 2025Updated 10 months ago
- An open, programmable decision layer for models and compute.☆6,391Updated this week
- Agent Skills as a Memory Layer☆3,698Oct 24, 2026Updated 2 weeks ago
- [Findings@ACL'26] LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing☆130Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,110Oct 24, 2026Updated 2 weeks ago
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆62,837Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,297Updated this week
- HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code…☆4,256Updated this week
- The absolute trainer to light up AI agents.☆18,908Updated this week
- Plan, run and supervise fleets of agents from task to merged PR. Desktop (macOS, Windows, Linux) + iPhone & Android apps. Supports Claud…☆14,167Updated this week
- Graph-Native Infrastructure for Context and Accountable AI Systems☆14,458Updated this week
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆40,123Updated this week
- Build Real-Time Knowledge Graphs for AI Agents☆32,593Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- "DeepCode: Open Agentic Coding (Agent Harness & Loop Engineering & Multi-Agent Orchestration)"☆16,810Updated this week
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,846Updated this week
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆13,776Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,063Updated this week
- Secure, Fast, and Extensible Sandbox runtime for AI agents.☆16,480Updated this week
- The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & So…☆6,652Updated this week
- The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.☆68,433Updated this week
- The batteries-included agent harness.☆31,038Updated this week
- Route LLM requests to the best model for the task at hand.☆359Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆13,335May 25, 2026Updated 5 months ago
- OpenKB: Open LLM Knowledge Base☆4,847Jul 22, 2026Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,465Updated this week
- [ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal☆3,870Jul 24, 2026Updated 3 months ago
- Superfast AI decision making and intelligent processing of multi-modal data.☆4,024Oct 22, 2026Updated 2 weeks ago
- Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal ex…☆4,214Updated this week
- OpenShell is the safe, private runtime for autonomous AI agents.☆21,206Updated this week
- The LLM Evaluation Framework☆19,334Updated this week
- Recursive-Open-Meta-Agent v0.1 (Beta). A meta-agent framework to build high-performance multi-agent systems.☆5,192Feb 16, 2026Updated 8 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,273Updated this week
- OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis☆1,267Jun 10, 2026Updated 4 months ago
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,297Updated this week
- "RAG-Anything: All-in-One RAG Framework"☆24,448Updated this week
- Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free☆33,112Updated this week
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,608Updated this week
- "AutoAgent: Fully-Automated and Zero-Code LLM Agent Framework"☆9,840Oct 16, 2025Updated last year