lm-sys / RouteLLM
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
☆3,256Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for RouteLLM
- Deploy your agentic worfklows to production☆1,834Updated this week
- Parse files for optimal RAG☆3,173Updated last week
- Harness LLMs with Multi-Agent Programming☆2,664Updated this week
- ☆2,746Updated 2 months ago
- Optimizing inference proxy for LLMs☆1,563Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,322Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI…☆2,111Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆2,830Updated this week
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,598Updated last month
- The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051…☆1,772Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,057Updated 2 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,653Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,115Updated this week
- The Open Source Memory Layer For Autonomous Agents☆1,483Updated 3 weeks ago
- Desktop app for prototyping and debugging LangGraph applications locally.☆1,934Updated this week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆4,784Updated this week
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆913Updated 3 weeks ago
- Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app☆1,265Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,467Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,546Updated last month
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆6,598Updated this week
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆3,906Updated last month
- PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LL…☆2,287Updated last week
- The easiest way to use Agentic RAG in any enterprise☆3,866Updated this week
- A language model programming library.☆5,295Updated this week
- Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper☆4,660Updated last month
- Build resilient language agents as graphs.☆6,715Updated this week
- Composable building blocks to build Llama Apps☆4,594Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,634Updated this week
- The LLM Evaluation Framework☆3,696Updated this week