Alternatives and similar repositories for core-bench

Users that are interested in core-bench are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆126Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆182Updated 6 months ago
• METR / RE-Bench
  ☆98Updated 4 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆110Updated 3 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆140Updated last week
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆272Updated this week
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆244Updated 2 months ago
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆182Updated 6 months ago
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆100Updated 2 weeks ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆162Updated last month
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆230Updated this week
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆158Updated 4 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• allenai / infinigram-api
  ☆80Updated last week
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆316Updated 7 months ago
• LiqiangJing / DSBench
  [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆72Updated 3 weeks ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆524Updated 2 months ago
• apple / ToolSandbox
  ☆204Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆96Updated 9 months ago
• snap-stanford / MLAgentBench
  ☆304Updated last year
• multi-agent-systems-failure-taxonomy / MAST
  ☆270Updated last month
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated 2 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆243Updated 5 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆295Updated this week
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 11 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆74Updated 3 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆97Updated 5 months ago
• ulab-uiuc / MARBLE
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆157Updated this week
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆399Updated this week
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆116Updated last year