Alternatives and similar repositories for llm-router

Users that are interested in llm-router are comparing it to the libraries listed below

• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆161Updated last week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆236Updated last year
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆192Updated 7 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 2 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• micytao / vllm-playground
  ☆120Updated last week
• NVIDIA-AI-Blueprints / data-flywheel
  ☆111Updated 2 weeks ago
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆141Updated 2 months ago
• run-ai / runai-model-streamer
  ☆268Updated last week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆730Updated this week
• google / lmeval
  ☆234Updated last week
• NVlabs / ToolOrchestra
  ToolOrchestra is an end-to-end RL training framework for orchestrating tools and agentic workflows.
  ☆289Updated this week
• bilalonur / awesome-llm-os
  A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating System…
  ☆139Updated this week
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆126Updated 10 months ago
• janhq / verifiers-deepresearch
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 2 months ago
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆93Updated 2 weeks ago
• philschmid / mcp-openai-gemini-llama-example
  ☆182Updated 9 months ago
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆92Updated 10 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆278Updated last month
• ibm-granite / granite-3.0-language-models
  ☆266Updated 5 months ago
• langchain-ai / langchain-nvidia
  ☆176Updated this week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆114Updated 2 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆226Updated last year
• bradAGI / GraphMemory
  GraphRAG database - hybrid graph / vector db
  ☆134Updated last year
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆200Updated 2 weeks ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆225Updated this week
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆450Updated 3 months ago
• weaviate / mcp-server-weaviate
  MCP (Model Context Protocol) server for Weaviate
  ☆159Updated 6 months ago
• i-am-bee / beeai-code-interpreter
  An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.
  ☆68Updated 2 months ago
• ag2ai / build-with-ag2
  Sample code and application showcases to get you going with AG2 (formally AutoGen)
  ☆195Updated last month