Alternatives and similar repositories for ScienceAgentBench:

Users that are interested in ScienceAgentBench are comparing it to the libraries listed below

• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 2 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆39Updated 4 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆69Updated last month
• AgentForceTeamOfficial / Baby-AIGS
  Official Implementation of the Baby-AIGS system
  ☆23Updated 4 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆65Updated 4 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆70Updated 3 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆78Updated 3 weeks ago
• xxxiaol / QRData
  Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
  ☆35Updated last month
• OSU-NLP-Group / awesome-agents4science
  A curated list of papers on LLMs and agents for scientific research and development
  ☆45Updated 3 months ago
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆86Updated 5 months ago
• thu-coai / SPaR
  ☆44Updated 3 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆83Updated last week
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆120Updated 3 months ago
• EagleW / Scientific-Inspiration-Machines-Optimized-for-Novelty
  Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
  ☆78Updated 11 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆130Updated 4 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆70Updated last month
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆142Updated last month
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆63Updated last month
• TIGER-AI-Lab / TheoremQA
  The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)
  ☆30Updated 10 months ago
• scandukuri / assistant-gate
  ☆20Updated 9 months ago
• google-deepmind / bbeh
  ☆59Updated last week
• open-compass / GPassK
  Official Repository of Are Your LLMs Capable of Stable Reasoning?
  ☆22Updated last week
• allenai / super-benchmark
  ☆40Updated last month
• du-nlp-lab / MLR-Copilot
  ☆60Updated last month
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆44Updated last month
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆56Updated last month
• dinobby / MAgICoRE
  ☆24Updated 6 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆117Updated last year