Alternatives and similar repositories for core-bench

Users that are interested in core-bench are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆217Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 10 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆168Updated last week
• METR / RE-Bench
  ☆133Updated 3 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆120Updated 2 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆488Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 10 months ago
• TextArena / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆345Updated 3 weeks ago
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆418Updated last week
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆169Updated 9 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆128Updated 7 months ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆214Updated last month
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆35Updated 6 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆246Updated 8 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆112Updated 9 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆120Updated 3 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆337Updated last week
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆302Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• ServiceNow / WorkArena
  WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?
  ☆230Updated last week
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆223Updated last month
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆578Updated last month
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆152Updated last year
• zai-org / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆163Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 11 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆219Updated last year
• LiqiangJing / DSBench
  [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆102Updated 5 months ago
• spcl / x1
  Official Implementation of "Reasoning Language Models: A Blueprint"
  ☆94Updated 6 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆235Updated 6 months ago