Alternatives and similar repositories for llm-router

Users that are interested in llm-router are comparing it to the libraries listed below

• anyscale / llm-router
  Tutorial for building LLM router
  ☆231Updated last year
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆112Updated 8 months ago
• agentsea / surfkit
  A toolkit for building computer use AI agents
  ☆176Updated 4 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 3 weeks ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆152Updated 3 weeks ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆110Updated last month
• philschmid / mcp-openai-gemini-llama-example
  ☆181Updated 8 months ago
• NVIDIA-AI-Blueprints / data-flywheel
  ☆99Updated last week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 7 months ago
• ag2ai / build-with-ag2
  Sample code and application showcases to get you going with AG2 (formally AutoGen)
  ☆174Updated last month
• menloresearch / verifiers-deepresearch
  Verifiers for LLM Reinforcement Learning
  ☆77Updated last month
• google / lmeval
  ☆232Updated 3 months ago
• run-ai / runai-model-streamer
  ☆258Updated last week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆214Updated last year
• weaviate / mcp-server-weaviate
  MCP (Model Context Protocol) server for Weaviate
  ☆154Updated 5 months ago
• SalesforceAIResearch / promptomatix
  An Automatic Prompt Optimization Framework for Large Language Models
  ☆130Updated 2 months ago
• SalesforceAIResearch / enterprise-deep-research
  Salesforce Enterprise Deep Research
  ☆147Updated last week
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆87Updated 3 weeks ago
• unslothai / unsloth-zoo
  Utils for Unsloth https://github.com/unslothai/unsloth
  ☆160Updated last week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆655Updated last week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆97Updated this week
• langchain-ai / langchain-nvidia
  ☆169Updated last week
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆100Updated last week
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆204Updated last week
• ibm-granite / granite-3.0-language-models
  ☆264Updated 4 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆73Updated last year
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆182Updated 5 months ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆112Updated 6 months ago
• bradAGI / GraphMemory
  GraphRAG database - hybrid graph / vector db
  ☆132Updated last year
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆446Updated 2 months ago