Route LLM requests to the best model for the task at hand.
☆353Jul 24, 2026Updated 2 months ago
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Customizable, AI-driven virtual assistant designed to streamline customer service operations, handle common inquiries, and improve overal…☆280Updated this week
- This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.☆794Sep 3, 2026Updated last month
- ☆133Updated this week
- The NVIDIA Deep Researcher Agent Blueprint is an open reference example for building intelligent AI agents that connect to your enterpris…☆899Oct 9, 2026Updated last week
- Improve safety, security, and privacy of AI systems at build, deploy and run stages.☆55Jan 27, 2026Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆49Aug 21, 2026Updated last month
- ☆227Apr 16, 2026Updated 6 months ago
- ☆74Jul 7, 2026Updated 3 months ago
- ☆34Jul 24, 2025Updated last year
- ☆96Aug 25, 2026Updated last month
- ☆47Apr 27, 2026Updated 5 months ago
- LLMRouter: An Open-Source Library for LLM Routing☆3,011Oct 9, 2026Updated last week
- ☆18Apr 21, 2026Updated 5 months ago
- The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.☆2,659Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderb…☆148Sep 29, 2026Updated 2 weeks ago
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆160Updated this week
- ☆144Updated this week
- A curated list of awesome approaches to AI model routing☆252Mar 24, 2025Updated last year
- NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics age…☆1,931Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,319Updated this week
- ☆14Mar 27, 2024Updated 2 years ago
- Transform PDFs into AI podcasts for engaging on-the-go audio content.☆880Updated this week
- ☆55Aug 31, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Drop-in causal memory for AI agents. Append-only event store with associations and bounded memory injection.☆25Aug 6, 2026Updated 2 months ago
- Powered by NVIDIA cuOpt: a GPU-accelerated portfolio optimization toolkit for building, backtesting, and scaling Mean-CVaR and Mean-Varia…☆499Sep 15, 2026Updated last month
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,613Aug 10, 2024Updated 2 years ago
- ☆16Dec 21, 2023Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- An NVIDIA AI Workbench example project for building with a downloadable NVIDIA NIM☆18Jun 20, 2026Updated 3 months ago
- Run:ai is the AI workload orchestration platform for Kubernetes. This monorepo contains the control plane services, in-cluster Kubernetes…☆453Updated this week
- A GenAI-powered catalog enrichment system that transforms basic product images into comprehensive, rich catalog☆45Sep 30, 2026Updated 2 weeks ago
- A comprehensive Helm chart for monitoring GPU resources in Kubernetes clusters. This tool provides real-time visibility into GPU allocati…☆35Aug 26, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICLR 2025] "GraphRouter: A Graph-based Router for LLM Selections", Tao Feng, Yanzhen Shen, Jiaxuan You☆82Dec 30, 2025Updated 9 months ago
- Tutorial for building LLM router☆259Jul 19, 2024Updated 2 years ago
- Reference implementation of the Agentic Commerce Protocol (ACP) and Universal Commerce Protocol (UCP)- enabling AI-powered checkout neg…☆81Updated this week
- A curated list of strategies, tools, papers, and resources for reducing LLM token costs and improving efficiency in production.☆97Updated this week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆5,345Updated this week
- Train text generation model with JavaScript.☆15Jul 14, 2024Updated 2 years ago
- ☆68May 19, 2025Updated last year