lm-sys / RouteLLM
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
☆3,935Updated 9 months ago
Alternatives and similar repositories for RouteLLM
Users that are interested in RouteLLM are comparing it to the libraries listed below
Sorting:
- The Open Source Memory Layer For Autonomous Agents☆2,205Updated 6 months ago
- Deploy your agentic worfklows to production☆2,004Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,077Updated 2 months ago
- Harness LLMs with Multi-Agent Programming☆3,305Updated this week
- Optimizing inference proxy for LLMs☆2,233Updated this week
- Structured Text Generation☆11,609Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,589Updated last week
- Knowledge Agents and Management in the Cloud☆3,967Updated last week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,976Updated last week
- structured outputs for llms☆10,411Updated last week
- Supercharge Your LLM Application Evaluations 🚀☆9,136Updated this week
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆1,055Updated this week
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,670Updated 4 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,700Updated last week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,442Updated 3 months ago
- The LLM Evaluation Framework☆6,331Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,658Updated this week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆6,547Updated this week
- AdalFlow: The library to build & auto-optimize LLM applications.☆3,031Updated last month
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,739Updated this week
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,751Updated 4 months ago
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆7,117Updated last month
- RAG that intelligently adapts to your use case, data, and queries☆3,250Updated last month
- Memory for AI Agents in 5 lines of code☆2,147Updated this week
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,213Updated 3 months ago
- A system for agentic LLM-powered data processing and ETL☆1,955Updated this week
- A language model programming library.☆5,759Updated 2 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆3,045Updated 2 weeks ago
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆4,060Updated 2 months ago
- AG2 (formerly AutoGen): The Open-Source AgentOS. Join us at: https://discord.gg/pAbnFJrkgZ☆2,552Updated this week