Alternatives and similar repositories for ScienceAgentBench:

Users that are interested in ScienceAgentBench are comparing it to the libraries listed below

• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆38Updated 3 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆35Updated last month
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆69Updated 2 months ago
• LiqiangJing / DSBench
  DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆43Updated this week
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆82Updated 4 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆31Updated last year
• belindal / ERASE
  Code and Data for "Language Modeling with Editable External Knowledge"
  ☆31Updated 8 months ago
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆35Updated this week
• allenai / super-benchmark
  ☆40Updated last week
• du-nlp-lab / LLM4SR
  LLM for Scientific Research Survey
  ☆50Updated 3 weeks ago
• ozyyshr / StructChem
  Structured Chemistry Reasoning with Large Language Models
  ☆32Updated 9 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆74Updated 10 months ago
• jiangjiechen / auction-arena
  Source code for our paper: "Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction A…
  ☆43Updated last year
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆38Updated 3 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆108Updated this week
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆61Updated 2 weeks ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• TIGER-AI-Lab / TheoremQA
  The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)
  ☆27Updated 9 months ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆73Updated last month
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆47Updated this week
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆52Updated this week
• zyzisastudyreallyhardguy / LLM4SD
  The Open Source Code for LLM4SD (Large Language Models for Scientific Synthesis, Inference and Explanation)
  ☆32Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 5 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆48Updated 2 weeks ago
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆24Updated 2 months ago
• AgentForceTeamOfficial / Baby-AIGS
  Official Implementation of the Baby-AIGS system
  ☆22Updated 2 months ago