Alternatives and similar repositories for llm-router

Users that are interested in llm-router are comparing it to the libraries listed below

• i-am-bee / beeai-code-interpreter
  An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.
  ☆65Updated 3 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆76Updated 6 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆145Updated this week
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆104Updated 7 months ago
• NVIDIA-AI-Blueprints / data-flywheel
  ☆85Updated 3 weeks ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 6 months ago
• IBM / prompt-declaration-language
  Prompt Declaration Language (PDL) is a declarative prompt programming language.
  ☆226Updated this week
• unslothai / unsloth-zoo
  Utils for Unsloth https://github.com/unslothai/unsloth
  ☆143Updated last week
• run-ai / runai-model-streamer
  ☆241Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆226Updated last year
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆76Updated this week
• ibm-granite-community / granite-retrieval-agent
  Build Research and Rag agents with Granite on your laptop
  ☆141Updated this week
• simular-ai / OpenACI
  Open Agent Computer Interface
  ☆86Updated 9 months ago
• google / lmeval
  ☆231Updated 2 months ago
• ag2ai / build-with-ag2
  Sample code and application showcases to get you going with AG2 (formally AutoGen)
  ☆170Updated 3 weeks ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆180Updated 4 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆203Updated 11 months ago
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆566Updated this week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆92Updated this week
• hcompai / surfer-h-cli
  Run Surfer-H agents powered by Holo1 using the Surfer-H-CLI. Includes example tasks, scripts, and configurations.
  ☆128Updated last month
• philschmid / mcp-openai-gemini-llama-example
  ☆182Updated 7 months ago
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆370Updated 3 weeks ago
• Not-Diamond / notdiamond-python
  Not Diamond Python SDK
  ☆89Updated last week
• agentsea / surfkit
  A toolkit for building computer use AI agents
  ☆174Updated 2 months ago
• NVIDIA-AI-Blueprints / aiq-research-assistant
  ☆165Updated last week
• Coral-Protocol / coral-server
  Open collaboration infrastructure that enables communication, coordination, trust and payments for The Internet of Agents.
  ☆146Updated this week
• Vaibhavs10 / experiments-with-mcp
  ☆102Updated 3 months ago
• microsoft / wina
  ☆144Updated last month
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆76Updated last week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆262Updated this week