Route LLM requests to the best model for the task at hand.
☆331Jul 24, 2026Updated this week
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Customizable, AI-driven virtual assistant designed to streamline customer service operations, handle common inquiries, and improve overal…☆270Jun 1, 2026Updated last month
- This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.☆719Updated this week
- ☆109Updated this week
- The AI-Q NVIDIA Blueprint is an open reference example for building intelligent AI agents that connect to your enterprise data, reason us…☆815Updated this week
- Improve safety, security, and privacy of AI systems at build, deploy and run stages.☆49Jan 27, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆63Jul 7, 2026Updated 3 weeks ago
- ☆46Mar 13, 2026Updated 4 months ago
- ☆180Apr 16, 2026Updated 3 months ago
- The Retail Shopping Assistant is an AI-powered blueprint that provides a comprehensive interface for an intelligent retail shopping advis…☆84Updated this week
- ☆69May 19, 2026Updated 2 months ago
- LLMRouter: An Open-Source Library for LLM Routing☆2,174Jul 13, 2026Updated 2 weeks ago
- The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.☆2,538Updated this week
- RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderb…☆114Updated this week
- [NeurIPS'25] Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learning☆148Dec 30, 2025Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆159Updated this week
- NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics age…☆1,754Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆7,608Updated this week
- ☆12Mar 27, 2024Updated 2 years ago
- A curated list of awesome approaches to AI model routing☆233Mar 24, 2025Updated last year
- Drop-in causal memory for AI agents. Append-only event store with associations and bounded memory injection.☆20Updated this week
- Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference☆5,068Updated this week
- Legacy password hashing framework for PHP applications needing to support or having previously supported PHP below 5.5☆15Nov 22, 2024Updated last year
- ☆20Jan 11, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An NVIDIA AI Workbench example project for building with a downloadable NVIDIA NIM☆16Jun 20, 2026Updated last month
- A comprehensive Helm chart for monitoring GPU resources in Kubernetes clusters. This tool provides real-time visibility into GPU allocati…☆32Jun 30, 2026Updated 3 weeks ago
- ⚡ Guidance, samples, and tools for HPC workloads on AKS clusters with RDMA and InfiniBand support, including GPUDirect RDMA.☆23Updated this week
- ☆63May 19, 2025Updated last year
- ☆75Updated this week
- vLLM adapter for a TGIS-compatible gRPC server.☆56Updated this week
- A runtime for writing reliable asynchronous applications with Rust. Provides I/O, networking, scheduling, timers, ...☆25Jun 18, 2026Updated last month
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,264Aug 10, 2024Updated last year
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆6,904Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Transform PDFs into AI podcasts for engaging on-the-go audio content.☆859Jun 26, 2026Updated last month
- NVIDIA Cloud Functions (NVCF) issue reporting and onboarding☆18May 5, 2026Updated 2 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆3,325Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆251Updated this week
- Collection of step-by-step playbooks for setting up AI/ML workloads on NVIDIA DGX Spark devices with Blackwell architecture.☆1,185Updated this week
- Routing on Random Forest (RoRF)☆245Sep 24, 2024Updated last year
- Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in…☆625Jul 20, 2026Updated last week