Alternatives and similar repositories for core-bench

Users that are interested in core-bench are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆97Updated 2 weeks ago
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆91Updated last month
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 4 months ago
• METR / RE-Bench
  ☆92Updated 2 months ago
• Nardien / agent-distillation
  Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"
  ☆115Updated last month
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆95Updated 3 months ago
• apple / ToolSandbox
  ☆185Updated 11 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆127Updated last week
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆163Updated 4 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆99Updated last month
• LiqiangJing / DSBench
  DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆58Updated 4 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 9 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆210Updated this week
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆99Updated 4 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆245Updated 9 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆154Updated 2 months ago
• quotient-ai / judges
  A small library of LLM judges
  ☆232Updated 3 weeks ago
• aorwall / moatless-tree-search
  ☆94Updated last month
• microsoft / stop
  Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
  ☆44Updated last year
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆113Updated 10 months ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆142Updated 2 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆163Updated this week
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆90Updated 7 months ago
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated last week
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆115Updated 5 months ago
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆133Updated 2 months ago
• ulab-uiuc / MARBLE
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆132Updated this week
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆66Updated last month
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆113Updated 5 months ago