lm-sys / RouteLLMLinks
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
☆4,455Updated last year
Alternatives and similar repositories for RouteLLM
Users that are interested in RouteLLM are comparing it to the libraries listed below
Sorting:
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,933Updated 3 weeks ago
- Deploy your agentic worfklows to production☆2,064Updated last week
- Harness LLMs with Multi-Agent Programming☆3,797Updated 3 weeks ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,566Updated 6 months ago
- Knowledge Agents and Management in the Cloud☆4,218Updated last week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,676Updated last month
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,852Updated 3 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆3,153Updated last week
- structured outputs for llms☆11,979Updated last week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,121Updated last month
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆2,108Updated last week
- The Open Source Memory Layer For Autonomous Agents☆2,513Updated last year
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,794Updated 6 months ago
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,128Updated last month
- AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation☆4,469Updated 3 weeks ago
- A language model programming library.☆5,843Updated 6 months ago
- ☆3,040Updated 3 weeks ago
- Optimizing inference proxy for LLMs☆3,221Updated last week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆4,293Updated 2 weeks ago
- Zep | Examples, Integrations, & More☆3,849Updated this week
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,518Updated 6 months ago
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,965Updated 3 months ago
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆1,078Updated 3 weeks ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,975Updated last year
- The easiest way to use Agentic RAG in any enterprise☆4,369Updated 10 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,979Updated 11 months ago
- Chat language model that can use tools and interpret the results☆1,588Updated last week
- [ICLR 2025] Automated Design of Agentic Systems☆1,473Updated 10 months ago
- AdalFlow: The library to build & auto-optimize LLM applications.☆3,905Updated 2 weeks ago
- AI Observability & Evaluation☆7,923Updated this week