withmartian / routerbenchLinks
The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
☆153Updated last year
Alternatives and similar repositories for routerbench
Users that are interested in routerbench are comparing it to the libraries listed below
Sorting:
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 10 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- Evaluating LLMs with fewer examples☆169Updated last year
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆184Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆222Updated 3 weeks ago
- accompanying material for sleep-time compute paper☆118Updated 8 months ago
- ☆229Updated 2 months ago
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆276Updated last week
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 6 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆223Updated 7 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆145Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆245Updated last year
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆236Updated 4 months ago
- ☆102Updated last year
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆51Updated last year
- A simple unified framework for evaluating LLMs☆258Updated 9 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- ☆108Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆316Updated 2 years ago
- The official evaluation suite and dynamic data release for MixEval.☆253Updated last year
- Source code for the collaborative reasoner research project at Meta FAIR.☆112Updated 8 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆410Updated last month
- Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"☆186Updated 2 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆256Updated this week
- ☆129Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆120Updated 2 months ago
- ☆88Updated 2 months ago
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- ☆242Updated last year