withmartian / routerbenchLinks
The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
☆132Updated last year
Alternatives and similar repositories for routerbench
Users that are interested in routerbench are comparing it to the libraries listed below
Sorting:
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆177Updated 5 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆174Updated last year
- ☆203Updated last year
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆223Updated this week
- Evaluating LLMs with fewer examples☆160Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆213Updated 3 weeks ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆201Updated this week
- Mixing Language Models with Self-Verification and Meta-Verification☆105Updated 8 months ago
- ☆41Updated 6 months ago
- Functional Benchmarks and the Reasoning Gap☆88Updated 10 months ago
- Complex Function Calling Benchmark.☆124Updated 7 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆92Updated 3 months ago
- accompanying material for sleep-time compute paper☆105Updated 3 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆308Updated last year
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆210Updated 3 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆100Updated 3 weeks ago
- Open Implementations of LLM Analyses☆106Updated 10 months ago
- The official evaluation suite and dynamic data release for MixEval.☆244Updated 9 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆54Updated last month
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆115Updated 11 months ago
- ☆130Updated 5 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆88Updated this week
- Simple extension on vLLM to help you speed up reasoning model without training.☆177Updated 2 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆270Updated last year
- ☆120Updated 6 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆209Updated 2 months ago
- ☆126Updated 10 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆101Updated 4 months ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆223Updated last year