Alternatives and similar repositories for RouteLLM

Users that are interested in RouteLLM are comparing it to the libraries listed below

• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,067Updated 3 weeks ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆3,141Updated last month
• algorithmicsuperintelligence / optillm
  Optimizing inference proxy for LLMs
  ☆3,252Updated last week
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,820Updated this week
• character-ai / prompt-poet
  Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.
  ☆1,129Updated 2 months ago
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,736Updated 2 months ago
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,227Updated 3 weeks ago
• MadcowD / ell
  A language model programming library.
  ☆5,869Updated 7 months ago
• circlemind-ai / fast-graphrag
  RAG that intelligently adapts to your use case, data, and queries
  ☆3,648Updated 2 months ago
• e2b-dev / code-interpreter
  Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
  ☆2,155Updated last week
• kingjulio8238 / Memary
  The Open Source Memory Layer For Autonomous Agents
  ☆2,525Updated last year
• getzep / zep
  Zep | Examples, Integrations, & More
  ☆3,905Updated 2 weeks ago
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,877Updated 4 months ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,805Updated 7 months ago
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,843Updated last year
• OpenAutoCoder / Agentless
  Agentless🐱: an agentless approach to automatically solve software development problems
  ☆1,994Updated last year
• KruxAI / ragbuilder
  A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data
  ☆1,522Updated 7 months ago
• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆3,958Updated this week
• ShengranHu / ADAS
  [ICLR 2025] Automated Design of Agentic Systems
  ☆1,480Updated 11 months ago
• build-with-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,220Updated last week
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆3,015Updated 2 weeks ago
• D-Star-AI / dsRAG
  High-performance retrieval engine for unstructured data
  ☆1,545Updated last month
• mistralai / mistral-finetune
  ☆3,056Updated last month
• 567-labs / instructor
  structured outputs for llms
  ☆12,065Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,652Updated 7 months ago
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,586Updated 2 weeks ago
• Scale3-Labs / langtrace
  Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…
  ☆1,086Updated last month
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,155Updated this week
• NousResearch / Hermes-Function-Calling
  ☆1,166Updated 2 weeks ago
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆6,216Updated last week