Alternatives and similar repositories for llm-router

Users that are interested in llm-router are comparing it to the libraries listed below

• LLMSELECTOR / LLMSELECTOR
  ☆79Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆156Updated 3 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆235Updated last year
• i-am-bee / beeai-code-interpreter
  An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.
  ☆68Updated 2 months ago
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆120Updated 9 months ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆188Updated 6 months ago
• microsoft / wina
  ☆144Updated 3 months ago
• bilalonur / awesome-llm-os
  A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating System…
  ☆138Updated 6 months ago
• weaviate / mcp-server-weaviate
  MCP (Model Context Protocol) server for Weaviate
  ☆157Updated 5 months ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆89Updated last week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆700Updated this week
• ibm-granite / granite-3.0-language-models
  ☆268Updated 4 months ago
• NVIDIA-AI-Blueprints / data-flywheel
  ☆104Updated last week
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆75Updated 11 months ago
• google / lmeval
  ☆234Updated 4 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆113Updated 2 months ago
• run-ai / runai-model-streamer
  ☆267Updated this week
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆447Updated 2 months ago
• NVIDIA-AI-Blueprints / aiq-research-assistant
  ☆216Updated 3 weeks ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆259Updated this week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆220Updated last year
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆93Updated last week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 8 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆276Updated this week
• bentoml / llm-optimizer
  Benchmark and optimize LLM inference across frameworks with ease
  ☆131Updated 2 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• IBM / prompt-declaration-language
  Prompt Declaration Language (PDL) is a declarative prompt programming language.
  ☆260Updated this week
• ibm-granite-community / granite-retrieval-agent
  Build Research and Rag agents with Granite on your laptop
  ☆146Updated last month
• ag2ai / build-with-ag2
  Sample code and application showcases to get you going with AG2 (formally AutoGen)
  ☆190Updated 2 weeks ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆248Updated last month