Alternatives and similar repositories for llm-router

Users that are interested in llm-router are comparing it to the libraries listed below

• LLMSELECTOR / LLMSELECTOR
  ☆78Updated last week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆179Updated 5 months ago
• NVIDIA-AI-Blueprints / data-flywheel
  ☆90Updated last month
• anyscale / llm-router
  Tutorial for building LLM router
  ☆228Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆150Updated last week
• IBM / prompt-declaration-language
  Prompt Declaration Language (PDL) is a declarative prompt programming language.
  ☆235Updated this week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆94Updated last week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆110Updated 2 weeks ago
• google / lmeval
  ☆232Updated 3 months ago
• philschmid / mcp-openai-gemini-llama-example
  ☆182Updated 7 months ago
• bilalonur / awesome-llm-os
  A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating System…
  ☆135Updated 5 months ago
• run-ai / runai-model-streamer
  ☆255Updated this week
• vllm-project / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆596Updated last week
• guidance-ai / jsonschemabench
  ☆61Updated 3 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 5 months ago
• weaviate / mcp-server-weaviate
  MCP (Model Context Protocol) server for Weaviate
  ☆153Updated 4 months ago
• langchain-ai / langchain-nvidia
  ☆168Updated last week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 7 months ago
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆192Updated 3 weeks ago
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆109Updated 8 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆211Updated last year
• substratusai / vllm-docker
  ☆64Updated 6 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆237Updated this week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆268Updated last week
• agentsea / surfkit
  A toolkit for building computer use AI agents
  ☆177Updated 3 months ago
• askbudi / tinyagent
  Tiny Agent: Production-Ready LLM Agent SDK for Every Developer
  ☆23Updated last week
• NVIDIA-AI-Blueprints / aiq-research-assistant
  ☆186Updated this week
• i-am-bee / beeai-code-interpreter
  An HTTP service intended as a backend for an LLM that can run arbitrary pieces of Python code.
  ☆66Updated 2 weeks ago
• mlc-ai / web-llm-assistant
  AI Assistant running within your browser.
  ☆72Updated 10 months ago
• ag2ai / build-with-ag2
  Sample code and application showcases to get you going with AG2 (formally AutoGen)
  ☆172Updated 2 weeks ago