Alternatives and similar repositories for llm-router

Users that are interested in llm-router are comparing it to the libraries listed below

• anyscale / llm-router
  Tutorial for building LLM router
  ☆224Updated last year
• LLMSELECTOR / LLMSELECTOR
  ☆74Updated 6 months ago
• langchain-ai / langchain-nvidia
  ☆162Updated this week
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆96Updated 6 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆140Updated this week
• weaviate / mcp-server-weaviate
  MCP (Model Context Protocol) server for Weaviate
  ☆146Updated 3 months ago
• ag2ai / build-with-ag2
  Sample code and application showcases to get you going with AG2 (formally AutoGen)
  ☆163Updated this week
• Not-Diamond / notdiamond-python
  Not Diamond Python SDK
  ☆88Updated last week
• agentsea / surfkit
  A toolkit for building computer use AI agents
  ☆172Updated 2 months ago
• i-am-bee / beeai-code-interpreter
  An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.
  ☆65Updated 2 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆195Updated 11 months ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆180Updated 3 months ago
• IBM / prompt-declaration-language
  Prompt Declaration Language (PDL) is a declarative prompt programming language.
  ☆209Updated last week
• ibm-granite-community / granite-retrieval-agent
  Build Research and Rag agents with Granite on your laptop
  ☆140Updated 3 months ago
• Coral-Protocol / coral-server
  Open collaboration infrastructure that enables communication, coordination, trust and payments for The Internet of Agents.
  ☆124Updated this week
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆70Updated this week
• leockl / tool-ahead-of-time
  This is a Python package to add tool calling capabilities to newly released LLMs on LangChain's ChatOpenAI, AzureAIChatCompletionsModel a…
  ☆120Updated 2 months ago
• run-ai / runai-model-streamer
  ☆238Updated this week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆501Updated this week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆104Updated this week
• dottxt-ai / demos
  ☆113Updated 5 months ago
• simular-ai / OpenACI
  Open Agent Computer Interface
  ☆85Updated 9 months ago
• jacoblee93 / mini-chat-langchain
  ☆60Updated 4 months ago
• Vaibhavs10 / experiments-with-mcp
  ☆102Updated 2 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆112Updated 3 weeks ago
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆211Updated 3 weeks ago
• philschmid / mcp-openai-gemini-llama-example
  ☆180Updated 6 months ago
• microsoft / wina
  ☆144Updated 3 weeks ago
• Scrapybara / scrapybara-python
  Scrapybara Python SDK
  ☆70Updated 2 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆250Updated 6 months ago