NVIDIA-AI-Blueprints / llm-routerLinks
Route LLM requests to the best model for the task at hand.
☆145Updated this week
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆162Updated last month
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆195Updated 7 months ago
- ☆239Updated 2 months ago
- ☆235Updated last month
- A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…☆172Updated this week
- Tutorial for building LLM router☆239Updated last year
- Benchmark and optimize LLM inference across frameworks with ease☆151Updated 3 months ago
- An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.☆69Updated 3 months ago
- Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, and full end-to-end reference exampl…☆246Updated this week
- MCP (Model Context Protocol) server for Weaviate☆160Updated 7 months ago
- Routing on Random Forest (RoRF)☆235Updated last year
- ☆79Updated 2 months ago
- ☆114Updated last month
- Run AI generated code in isolated sandboxes☆131Updated 10 months ago
- Standardized environment infrastructure for Agentic AI development.☆211Updated this week
- Tiny Agent: Production-Ready LLM Agent SDK for Every Developer☆30Updated 2 months ago
- ☆178Updated this week
- Build Research and Rag agents with Granite on your laptop☆149Updated 2 months ago
- ☆117Updated 4 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆246Updated this week
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆451Updated 4 months ago
- Sample code and application showcases to get you going with AG2 (formally AutoGen)☆207Updated last week
- A Text-Based Environment for Interactive Debugging☆286Updated last week
- A collection of all available inference solutions for the LLMs☆93Updated 9 months ago
- The NVIDIA NeMo Agent Toolkit UI streamlines interacting with NeMo Agent Toolkit workflows in an easy-to-use web application.☆60Updated last week
- ☆182Updated 10 months ago
- ☆686Updated last week
- Inference, Fine Tuning and many more recipes with Gemma family of models☆276Updated 5 months ago
- Agent computer interface for AI software engineer.☆115Updated 2 weeks ago
- API Server for Transformer Lab☆81Updated last month