Alternatives and similar repositories for RouteLLM

Users that are interested in RouteLLM are comparing it to the libraries listed below

• codelion / optillm
  Optimizing inference proxy for LLMs
  ☆2,550Updated this week
• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,026Updated this week
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,014Updated this week
• e2b-dev / code-interpreter
  Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
  ☆1,815Updated last week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,634Updated last month
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,402Updated this week
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,716Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,174Updated 3 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,757Updated last week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,496Updated last month
• KruxAI / ragbuilder
  A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data
  ☆1,429Updated last month
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,759Updated 5 months ago
• kingjulio8238 / Memary
  The Open Source Memory Layer For Autonomous Agents
  ☆2,252Updated 7 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,024Updated 3 weeks ago
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,843Updated this week
• langchain-ai / langgraph-studio
  Desktop app for prototyping and debugging LangGraph applications locally.
  ☆2,952Updated this week
• character-ai / prompt-poet
  Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.
  ☆1,068Updated this week
• 567-labs / instructor
  structured outputs for llms
  ☆10,747Updated last week
• D-Star-AI / dsRAG
  High-performance retrieval engine for unstructured data
  ☆1,408Updated last week
• ucbepic / docetl
  A system for agentic LLM-powered data processing and ETL
  ☆2,223Updated this week
• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆3,328Updated 2 months ago
• run-llama / create-llama
  The easiest way to get started with LlamaIndex
  ☆1,424Updated this week
• SciPhi-AI / R2R
  SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.
  ☆6,985Updated last week
• OpenAutoCoder / Agentless
  Agentless🐱: an agentless approach to automatically solve software development problems
  ☆1,725Updated 5 months ago
• BrainBlend-AI / atomic-agents
  Building AI agents, atomically
  ☆3,964Updated 3 weeks ago
• ragapp / ragapp
  The easiest way to use Agentic RAG in any enterprise
  ☆4,262Updated 4 months ago
• ShengranHu / ADAS
  [ICLR 2025] Automated Design of Agentic Systems
  ☆1,342Updated 4 months ago
• mistralai / mistral-finetune
  ☆2,965Updated 9 months ago
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,563Updated this week
• weaviate / Verba
  Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
  ☆7,169Updated 2 months ago