withmartian / routerbench
The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
☆116Updated 10 months ago
Alternatives and similar repositories for routerbench:
Users that are interested in routerbench are comparing it to the libraries listed below
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆167Updated last month
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated 10 months ago
- ☆115Updated last month
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆196Updated last week
- Mixing Language Models with Self-Verification and Meta-Verification☆103Updated 4 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆65Updated this week
- Complex Function Calling Benchmark.☆92Updated 2 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆86Updated last week
- ☆164Updated 8 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆133Updated 5 months ago
- Functional Benchmarks and the Reasoning Gap☆85Updated 6 months ago
- ☆70Updated 5 months ago
- Evaluating LLMs with fewer examples☆150Updated last year
- ☆105Updated 2 months ago
- DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆50Updated last month
- A simple unified framework for evaluating LLMs☆210Updated last week
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆175Updated this week
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆170Updated 3 months ago
- Train your own SOTA deductive reasoning model☆83Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Users☆221Updated 5 months ago
- ☆119Updated 6 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆254Updated 9 months ago
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆106Updated 7 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆86Updated 3 weeks ago
- Codebase accompanying the Summary of a Haystack paper.☆77Updated 6 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆186Updated last week
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆299Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆144Updated 2 months ago
- ☆192Updated last month