Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper//arxiv.org/abs/2506.22716
☆64Jul 2, 2026Updated last week
Alternatives and similar repositories for best-route-llm
Users that are interested in best-route-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆35Feb 17, 2026Updated 4 months ago
- [ACL 2025 Main] (🏆 Outstanding Paper Award) Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Proba…☆18Aug 15, 2025Updated 10 months ago
- The wafer-native AI accelerator simulation platform and inference engine.☆56Jan 1, 2026Updated 6 months ago
- [ACL'25] Code for ACL'25 paper "IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory"☆34Feb 19, 2025Updated last year
- An open-source simulator framework for neural processing units☆44Jun 22, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- FedNew: A Communication-Efficient and Privacy-Preserving Newton-Type Method for Federated Learning☆17Jun 2, 2022Updated 4 years ago
- ☆90Oct 17, 2025Updated 8 months ago
- [NeurIPS'25] Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learning☆140Dec 30, 2025Updated 6 months ago
- The code of RouterDC☆75Apr 14, 2025Updated last year
- ☆15Dec 22, 2022Updated 3 years ago
- A class for synchronizing sensor readings to the system clock☆11Oct 25, 2018Updated 7 years ago
- Code for SIGKDD2025 paper: An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problem☆14Jan 28, 2025Updated last year
- ☆12Apr 23, 2026Updated 2 months ago
- ☆16Apr 13, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆16Jan 14, 2025Updated last year
- MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation☆18Sep 2, 2024Updated last year
- Code for the paper "Age of Information Analysis in Edge Computing Servers"☆22Feb 12, 2024Updated 2 years ago
- Microsoft's open source max-min fair solver for cluster scheduling and traffic engineering☆19Apr 13, 2026Updated 2 months ago
- [ICML 2024] Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models☆24Sep 12, 2024Updated last year
- A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in Large Language Models☆119Jun 3, 2026Updated last month
- LGDCloudSim is a resource management simulation system for large-scale geographically distributed cloud data center scenarios.☆16Mar 6, 2026Updated 4 months ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆19Dec 8, 2023Updated 2 years ago
- ☆16Feb 10, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The official repository of ICCV 2025 paper "CATP-LLM: Empowering Large Language Models for Cost-Aware Tool Planning".☆20Nov 26, 2025Updated 7 months ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆12Feb 11, 2024Updated 2 years ago
- ☆14Dec 20, 2024Updated last year
- Burstable Cloud Scheduler☆17Jun 6, 2024Updated 2 years ago
- [ICML 2025] X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP☆48Feb 3, 2026Updated 5 months ago
- ☆51Nov 9, 2025Updated 7 months ago
- A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.☆12Oct 12, 2018Updated 7 years ago
- LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure☆323Jun 29, 2026Updated last week
- [DAI 2025] Beyond GPT-5: Making LLMs Cheaper and Better via Performance–Efficiency Optimized Routing☆215Dec 11, 2025Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Mitigating Routing Update Overhead for Traffic Engineering by Combining Destination-based Routing with Reinforcement Learning☆15Oct 16, 2022Updated 3 years ago
- A comprehensive overview of Data Distillation and Condensation (DDC). DDC is a data-centric task where a representative (i.e., small but …☆13Dec 1, 2022Updated 3 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆13Mar 7, 2024Updated 2 years ago
- [TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Pratees…☆21Jun 19, 2026Updated 2 weeks ago
- ☆26Jul 30, 2025Updated 11 months ago
- SYMBXRL: Symbolic Explainable Deep Reinforcement Learning for Mobile Networks☆22Apr 1, 2026Updated 3 months ago
- Predict the performance of LLM inference services☆23Sep 18, 2025Updated 9 months ago