Tutorial for building LLM router
☆261Jul 19, 2024Updated 2 years ago
Alternatives and similar repositories for llm-router
Users that are interested in llm-router are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,681Aug 10, 2024Updated 2 years ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆189Jun 13, 2024Updated 2 years ago
- Fine-tune an LLM to perform batch inference and online serving.☆127May 29, 2025Updated last year
- A curated list of awesome approaches to AI model routing☆253Mar 24, 2025Updated last year
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,260Mar 13, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆45Dec 14, 2024Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 3 years ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆207Jul 17, 2024Updated 2 years ago
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,923Jan 21, 2024Updated 2 years ago
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,174Oct 8, 2024Updated 2 years ago
- Framework for Cost-Effective Language Model Choice☆16Dec 12, 2023Updated 2 years ago
- Distributed multi-agent framework for event-driven, graph-based computation. Elixir/Python, NATS event streaming, modular operator/XCS ar…☆14Mar 25, 2026Updated 7 months ago
- ☆11Jan 3, 2024Updated 2 years ago
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,786Jul 25, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data visualization code generation benchmark: Evaluates LLMs' ability to generate visualization code from DataFrame descriptions.☆13Nov 28, 2025Updated 11 months ago
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,949Jun 25, 2026Updated 4 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆120Apr 27, 2026Updated 6 months ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads☆2,774Jun 25, 2024Updated 2 years ago
- II-Thought-RL is our initial attempt at developing a large-scale, multi-domain Reinforcement Learning (RL) dataset☆30Apr 8, 2025Updated last year
- Superfast AI decision making and intelligent processing of multi-modal data.☆4,024Oct 22, 2026Updated 2 weeks ago
- This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis☆11Feb 17, 2023Updated 3 years ago
- Not Diamond Python SDK☆91Dec 11, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆64Aug 30, 2024Updated 2 years ago
- Examples and Demos using the Cohere APIs☆23Nov 3, 2023Updated 3 years ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆174Oct 19, 2024Updated 2 years ago
- ☆562May 25, 2026Updated 5 months ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,232Oct 10, 2026Updated 3 weeks ago
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,994Jan 7, 2025Updated last year
- openperplex is an opensource AI search engine☆888Aug 4, 2024Updated 2 years ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆122Mar 31, 2025Updated last year
- A workbench application to test out different prompts on a variety of AI models to see how they perform☆15Feb 9, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆349Jun 16, 2024Updated 2 years ago
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆46Jan 11, 2024Updated 2 years ago
- Official Code for Oᴘᴇɴ-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models (EMNLP Findings 2024)☆145Feb 20, 2025Updated last year
- DSPy: The framework for programming—not prompting—language models☆38,961Updated this week
- ☆10Oct 31, 2023Updated 3 years ago
- Chat²GPT is a ChatGPT (and DALL·E 2/3, and ElevenLabs) chat bot for Google Chat. 🤖💬☆11Feb 2, 2026Updated 9 months ago
- Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""☆3,966Nov 25, 2024Updated last year