lm-sys / RouteLLMLinks
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
☆4,274Updated last year
Alternatives and similar repositories for RouteLLM
Users that are interested in RouteLLM are comparing it to the libraries listed below
Sorting:
- Deploy your agentic worfklows to production☆2,055Updated 2 weeks ago
- Knowledge Agents and Management in the Cloud☆4,139Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,423Updated 6 months ago
- Harness LLMs with Multi-Agent Programming☆3,695Updated last week
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,780Updated last month
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,796Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,417Updated 3 months ago
- Optimizing inference proxy for LLMs☆2,863Updated this week
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,824Updated 8 months ago
- ☆3,016Updated last year
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,106Updated last month
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,981Updated 2 weeks ago
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆1,024Updated 4 months ago
- Zep | Examples, Integrations, & More☆3,632Updated this week
- Desktop app for prototyping and debugging LangGraph applications locally.☆3,215Updated 2 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,904Updated 8 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,878Updated last week
- AdalFlow: The library to build & auto-optimize LLM applications.☆3,701Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,662Updated 4 months ago
- The Open Source Memory Layer For Autonomous Agents☆2,479Updated 10 months ago
- ☆1,976Updated this week
- Structured Outputs☆12,560Updated last week
- structured outputs for llms☆11,421Updated this week
- AG2 (formerly AutoGen): The Open-Source AgentOS. Join us at: https://discord.gg/pAbnFJrkgZ☆3,549Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆4,884Updated last week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆3,110Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆4,236Updated 2 weeks ago
- LLM abstractions that aren't obstructions☆1,263Updated this week
- ☆1,077Updated last year
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆3,486Updated last week