Alternatives and similar repositories for core-bench

Users that are interested in core-bench are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆117Updated 2 weeks ago
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆98Updated 2 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆132Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆177Updated 5 months ago
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆174Updated 5 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆303Updated 6 months ago
• METR / RE-Bench
  ☆98Updated 4 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆245Updated last week
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆33Updated last month
• ulab-uiuc / MARBLE
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆148Updated this week
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆158Updated 4 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆104Updated 2 months ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆160Updated 2 weeks ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆238Updated last month
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆211Updated last year
• multi-agent-systems-failure-taxonomy / MAST
  ☆259Updated last month
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆72Updated 3 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆93Updated 4 months ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 3 months ago
• ServiceNow / AgentLab
  AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…
  ☆386Updated this week
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆238Updated 2 weeks ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆101Updated 4 months ago
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆193Updated 2 months ago
• snap-stanford / MLAgentBench
  ☆301Updated last year
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆240Updated 4 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆229Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆209Updated last week
• ServiceNow / WorkArena
  WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?
  ☆201Updated last week
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆176Updated 3 months ago