NVIDIA-AI-Blueprints / llm-routerLinks
Route LLM requests to the best model for the task at hand.
☆113Updated last month
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below
Sorting:
- Tutorial for building LLM router☆231Updated last year
- Run AI generated code in isolated sandboxes☆112Updated 8 months ago
- A toolkit for building computer use AI agents☆176Updated 4 months ago
- ☆79Updated 3 weeks ago
- Self-host LLMs with vLLM and BentoML☆152Updated 3 weeks ago
- Agent computer interface for AI software engineer.☆110Updated last month
- ☆181Updated 8 months ago
- ☆99Updated last week
- A collection of all available inference solutions for the LLMs☆91Updated 7 months ago
- Sample code and application showcases to get you going with AG2 (formally AutoGen)☆174Updated last month
- Verifiers for LLM Reinforcement Learning☆77Updated last month
- ☆232Updated 3 months ago
- ☆258Updated last week
- Routing on Random Forest (RoRF)☆214Updated last year
- MCP (Model Context Protocol) server for Weaviate☆154Updated 5 months ago
- An Automatic Prompt Optimization Framework for Large Language Models☆130Updated 2 months ago
- Salesforce Enterprise Deep Research☆147Updated last week
- ScalarLM - a unified training and inference stack☆87Updated 3 weeks ago
- Utils for Unsloth https://github.com/unslothai/unsloth☆160Updated last week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆655Updated last week
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆97Updated this week
- ☆169Updated last week
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆100Updated last week
- Super basic implementation (gist-like) of RLMs with REPL environments.☆204Updated last week
- ☆264Updated 4 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆73Updated last year
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆182Updated 5 months ago
- Unsloth Studio☆112Updated 6 months ago
- GraphRAG database - hybrid graph / vector db☆132Updated last year
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆446Updated 2 months ago