Alternatives and similar repositories for ScienceAgentBench

Users that are interested in ScienceAgentBench are comparing it to the libraries listed below

• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆85Updated last month
• OSU-NLP-Group / awesome-agents4science
  A curated list of papers on LLMs and agents for scientific research and development
  ☆54Updated 5 months ago
• AgentForceTeamOfficial / Baby-AIGS
  Official Implementation of the Baby-AIGS system
  ☆23Updated 5 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆80Updated 5 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆35Updated 2 months ago
• TIGER-AI-Lab / TheoremQA
  The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)
  ☆31Updated last year
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆40Updated 6 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆57Updated 3 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆135Updated 5 months ago
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆71Updated last month
• LiqiangJing / DSBench
  DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆52Updated 2 months ago
• mandyyyyii / scibench
  ☆120Updated 10 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆79Updated last year
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆97Updated 6 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆119Updated this week
• allenai / super-benchmark
  ☆42Updated last month
• du-nlp-lab / LLM4SR
  LLM for Scientific Research Survey
  ☆85Updated 3 months ago
• jiangjiechen / auction-arena
  Source code for our paper: "Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction A…
  ☆44Updated last year
• du-nlp-lab / MLR-Copilot
  ☆64Updated last month
• ozyyshr / StructChem
  Structured Chemistry Reasoning with Large Language Models
  ☆37Updated last year
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆58Updated last month
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆121Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆84Updated 5 months ago
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆48Updated 6 months ago
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆92Updated 2 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆57Updated 5 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆120Updated 8 months ago
• google / spiqa
  Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]
  ☆58Updated 4 months ago