Alternatives and similar repositories for routerbench

Users that are interested in routerbench are comparing it to the libraries listed below

• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆167Updated last year
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆118Updated last year
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆178Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆218Updated last week
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆117Updated 6 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆258Updated last week
• apple / ToolSandbox
  ☆224Updated last week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆244Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆94Updated 5 months ago
• zai-org / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆147Updated 9 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆254Updated 7 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆252Updated last year
• ScalerLab / JudgeBench
  ☆103Updated last year
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆100Updated this week
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 9 months ago
• zorazrw / awesome-tool-llm
  ☆239Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆264Updated 2 weeks ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• SalesforceAIResearch / LaTRO
  ☆124Updated 8 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆116Updated 3 weeks ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆242Updated last year
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆56Updated 4 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆219Updated 5 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆311Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆144Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 7 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆233Updated 3 months ago
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆348Updated this week