Efficient LLM query routing via multi-sampling. BEST-Route selects both model and number of responses based on query difficulty, cutting costs by up to 60% with <1% performance drop. From the paper//arxiv.org/abs/2506.22716
☆70Oct 19, 2026Updated last week
Alternatives and similar repositories for best-route-llm
Users that are interested in best-route-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in Large Language Models☆125Jun 3, 2026Updated 4 months ago
- vLLM wall-clock emulation pluging to allow running the real vllm serve and benchmark without gpu with simple mocking☆16Aug 21, 2026Updated 2 months ago
- [ICLR 2025] "GraphRouter: A Graph-based Router for LLM Selections", Tao Feng, Yanzhen Shen, Jiaxuan You☆82Dec 30, 2025Updated 10 months ago
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- ☆18Aug 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆27Feb 28, 2025Updated last year
- Burstable Cloud Scheduler☆17Jun 6, 2024Updated 2 years ago
- [ACL'25] Code for ACL'25 paper "IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory"☆36Feb 19, 2025Updated last year
- [NeurIPS 2025] CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension☆22Oct 8, 2025Updated last year
- [NeurIPS'25] Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learning☆155Dec 30, 2025Updated 10 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,662Aug 10, 2024Updated 2 years ago
- Backdoor training and evaluation scripts for vision-language-action models on LIBERO.☆12Jul 25, 2026Updated 3 months ago
- CoT2ToT: Chain-of-Thought to Tree-of-Thoughts CoT2ToT is a Python package that processes and visualizes chain-of-thought (CoT) outputs f…☆13Feb 16, 2025Updated last year
- A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble"☆256Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Surrogate-based Hyperparameter Tuning System☆30Jun 29, 2023Updated 3 years ago
- ☆10Aug 24, 2023Updated 3 years ago
- Sample app for podcast generation using Azure OpenAI☆21Mar 7, 2025Updated last year
- Code for "Thinking Forward: Memory-Efficient Federated Finetuning of Language Models" (NeurIPS 2024). Spry is a federated learning al…☆13Oct 8, 2024Updated 2 years ago
- Robust Federated Learning for Large Language Models in Adversarial Wireless Environments☆16Mar 7, 2025Updated last year
- prot_learn is a PyTorch-based machine learning toolbox designed for protein analysis☆14Jun 1, 2026Updated 5 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆120Dec 12, 2024Updated last year
- AI model training on heterogeneous, geo-distributed resources☆47Nov 24, 2025Updated 11 months ago
- Code and data for the ICSE 2025 paper "HumanEvo: An Evolving-aware Benchmark for More Realistic Evaluation of Repository-level Code Gener…☆13Feb 10, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆16Jun 4, 2025Updated last year
- This repository is the official implementation of "Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE" [ACL 2026 Mai…☆39Oct 5, 2025Updated last year
- MetaOpt: Towards efficient heuristic design with quantifiable and confident performance☆23Sep 14, 2026Updated last month
- [CVPR 2023] Adversarial Robustness via Random Projection Filters☆13Jun 20, 2023Updated 3 years ago
- Code for the paper "Firewalls to Secure Dynamic LLM Agentic Networks"☆30Jun 6, 2025Updated last year
- Replication package of the paper "AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models"…☆10Sep 26, 2022Updated 4 years ago
- Tools to speed up migration from other SSE solutions to Microsoft's Global Secure Access☆20Updated this week
- Homebrew Tap for Microsoft's Git projects.☆27Oct 26, 2026Updated last week
- ☆15Jul 31, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14May 23, 2025Updated last year
- A parallel evaluation data set of SAP software documentation with document structure annotation☆15Jun 12, 2026Updated 4 months ago
- FedJudge: Federated Legal Large Language Model☆36Sep 19, 2024Updated 2 years ago
- ☆11Dec 1, 2024Updated last year
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- Serverless Paper Reading and Discussion☆37Jan 9, 2023Updated 3 years ago
- COMET for African languages☆11Jan 24, 2025Updated last year