NVIDIA-AI-Blueprints / llm-routerLinks
Route LLM requests to the best model for the task at hand.
☆161Updated last week
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below
Sorting:
- Community maintained hardware plugin for vLLM on Apple Silicon☆260Updated this week
- ☆257Updated this week
- Tutorial for building LLM router☆242Updated last year
- Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench☆199Updated 8 months ago
- Self-host LLMs with vLLM and BentoML☆163Updated last month
- ☆79Updated 3 months ago
- Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, and full end-to-end reference exampl…☆349Updated this week
- Ranking LLMs on agentic tasks☆208Updated last month
- Run AI generated code in isolated sandboxes☆135Updated 11 months ago
- Agent computer interface for AI software engineer.☆115Updated last month
- This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang☆96Updated this week
- MCP (Model Context Protocol) server for Weaviate☆162Updated 7 months ago
- ☆120Updated last month
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆256Updated this week
- ☆236Updated last month
- ☆181Updated last week
- A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…☆331Updated this week
- The official code implementation for "Cache-to-Cache: Direct Semantic Communication Between Large Language Models"☆314Updated this week
- Benchmark and optimize LLM inference across frameworks with ease☆155Updated 4 months ago
- ☆120Updated 5 months ago
- CUGA is an open-source generalist agent for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integrations, …☆637Updated 3 weeks ago
- Routing on Random Forest (RoRF)☆238Updated last year
- Verifiers for LLM Reinforcement Learning☆80Updated 4 months ago
- Sample code and application showcases to get you going with AG2 (formally AutoGen)☆209Updated 2 weeks ago
- An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.☆69Updated 4 months ago
- Tiny Agent: Production-Ready LLM Agent SDK for Every Developer☆31Updated 3 months ago
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆266Updated 8 months ago
- A Text-Based Environment for Interactive Debugging☆288Updated last week
- ☆269Updated 6 months ago
- Own your AI, search the web with it🌐😎☆94Updated last year