lm-sys / RouteLLM
A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
☆3,207Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for RouteLLM
- Deploy your agentic worfklows to production☆1,817Updated this week
- RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry☆3,270Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI…☆2,010Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,077Updated last week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,031Updated 2 months ago
- Harness LLMs with Multi-Agent Programming☆2,611Updated this week
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆2,819Updated this week
- Parse files for optimal RAG☆3,019Updated this week
- ☆2,732Updated last month
- The easiest way to use Agentic RAG in any enterprise☆3,804Updated this week
- The all-in-one solution for RAG. Build, scale, and deploy state of the art Retrieval-Augmented Generation applications☆3,553Updated this week
- The Open Source Memory Layer For Autonomous Agents☆1,464Updated 2 weeks ago
- Desktop app for prototyping and debugging LangGraph applications locally.☆1,871Updated this week
- A language model programming library.☆5,185Updated this week
- Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.☆910Updated last week
- Optimizing inference proxy for LLMs☆1,329Updated this week
- PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LL…☆2,260Updated this week
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆4,650Updated this week
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,593Updated 3 weeks ago
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆6,302Updated this week
- Retrieval Augmented Generation (RAG) chatbot powered by Weaviate☆6,253Updated this week
- structured outputs for llms☆8,068Updated this week
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,252Updated this week
- Easy token price estimates for 400+ LLMs. TokenOps.☆1,453Updated last week
- Composable building blocks to build Llama Apps☆4,477Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,609Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,601Updated 2 months ago
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆13,615Updated this week
- Build resilient language agents as graphs.☆6,531Updated this week
- The LLM Evaluation Framework☆3,541Updated this week