The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
☆189Jun 13, 2024Updated 2 years ago
Alternatives and similar repositories for routerbench
Users that are interested in routerbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tutorial for building LLM router☆261Jul 19, 2024Updated 2 years ago
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆21Aug 13, 2024Updated 2 years ago
- Framework for Cost-Effective Language Model Choice☆16Dec 12, 2023Updated 2 years ago
- [NeurIPS'25] Router-R1: Teaching LLMs Multi-Round Routing and Aggregation via Reinforcement Learning☆156Dec 30, 2025Updated 10 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆5,701Aug 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR 2025] "GraphRouter: A Graph-based Router for LLM Selections", Tao Feng, Yanzhen Shen, Jiaxuan You☆83Dec 30, 2025Updated 10 months ago
- Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.☆34Oct 28, 2026Updated 2 weeks ago
- Repo for EmbedLLM: Learning Compact Representations of Large Language Models☆34Sep 25, 2025Updated last year
- ☆13Aug 12, 2026Updated 3 months ago
- Official repository for RePro: Training Language Models to Faithfully Recycle the Web for Pretraining☆11Feb 18, 2026Updated 8 months ago
- Routing on Random Forest (RoRF)☆245Sep 24, 2024Updated 2 years ago
- Agent that routes to different tools - LLM classifier SDK☆46Jun 25, 2024Updated 2 years ago
- The code of RouterDC☆78Apr 14, 2025Updated last year
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆95May 23, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderb…☆158Updated this week
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
- Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…☆14Jan 19, 2024Updated 2 years ago
- ☆56Jun 26, 2025Updated last year
- The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)☆14Mar 8, 2025Updated last year
- ☆105Dec 6, 2024Updated last year
- [Findings@ACL'26] LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing☆133Nov 2, 2026Updated last week
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆14Mar 7, 2024Updated 2 years ago
- ☆15Dec 10, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆220Mar 7, 2025Updated last year
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆30Jul 24, 2025Updated last year
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,922Jan 21, 2024Updated 2 years ago
- ☆10Mar 10, 2019Updated 7 years ago
- This repository contains the codebase for the paper Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection☆11Jun 30, 2025Updated last year
- [ICLR 2026] "GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs", Tao Feng, Haozhen Zhang, Zijie Lei, Peixuan Han,…☆24Apr 26, 2026Updated 6 months ago
- A curated list of awesome works in Routing LLMs paradigm (👉 Welcome to submit your contributions to this code repository)☆190Oct 30, 2026Updated 2 weeks ago
- Code for the ICLR'24 paper: "Visual Data-Type Understanding does not emerge from Scaling Vision-Language Models"☆13Jan 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble" (IJCA…☆259Updated this week
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Oct 1, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- ☆56Jun 23, 2026Updated 4 months ago
- This repository includes the implementation and results of the paper "ChatGPT is fun, but it is not funny! Humor is still challenging Lar…☆13Jul 13, 2023Updated 3 years ago
- Code for Fooling Contrastive Language-Image Pre-trainined Models with CLIPMasterPrints☆15Jan 25, 2026Updated 9 months ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆318Jul 13, 2025Updated last year
Are these results useful?