Alternatives and similar repositories for routerbench:

Users that are interested in routerbench are comparing it to the libraries listed below

• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆172Updated 2 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 10 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆151Updated last year
• apple / ToolSandbox
  ☆166Updated 8 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆86Updated this week
• ScalerLab / JudgeBench
  ☆72Updated 6 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated last week
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆104Updated 4 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆85Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆88Updated last month
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆134Updated 5 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆107Updated 7 months ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆99Updated 3 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆192Updated 2 weeks ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆104Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 6 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆255Updated 9 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆198Updated last month
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆301Updated last year
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆112Updated last week
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆130Updated 8 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated 3 weeks ago
• matthewrenze / self-reflection
  Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
  ☆69Updated 5 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆190Updated 5 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆36Updated 9 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆102Updated 7 months ago
• architsharma97 / dpo-rlaif
  ☆97Updated 10 months ago
• myscale / Retrieval-QA-Benchmark
  Benchmark baseline for retrieval qa applications
  ☆109Updated last year
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago