withmartian / routerbenchLinks
The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
☆142Updated last year
Alternatives and similar repositories for routerbench
Users that are interested in routerbench are comparing it to the libraries listed below
Sorting:
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆184Updated 6 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated last year
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆176Updated last year
- Evaluating LLMs with fewer examples☆161Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆216Updated 2 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆237Updated this week
- ☆211Updated last year
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆263Updated last week
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆143Updated 10 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆94Updated this week
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 2 months ago
- [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.☆197Updated 4 months ago
- accompanying material for sleep-time compute paper☆115Updated 5 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆151Updated this week
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆129Updated 7 months ago
- Complex Function Calling Benchmark.☆135Updated 8 months ago
- ☆123Updated 7 months ago
- ☆99Updated 10 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆155Updated 5 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆241Updated 11 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated 11 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆93Updated 4 months ago
- A simple unified framework for evaluating LLMs☆248Updated 5 months ago
- ☆133Updated 6 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 9 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆311Updated last year
- ☆240Updated last year
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆202Updated 3 months ago