OSU-NLP-Group / ScienceAgentBenchLinks
[ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
☆122Updated 4 months ago
Alternatives and similar repositories for ScienceAgentBench
Users that are interested in ScienceAgentBench are comparing it to the libraries listed below
Sorting:
- A curated list of papers on LLMs and agents for scientific research and development☆84Updated last year
- A virtual environment for developing and evaluating automated scientific discovery agents.☆199Updated 10 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆114Updated 5 months ago
- Discovering Data-driven Hypotheses in the Wild☆127Updated 7 months ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆141Updated last year
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated last year
- [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆99Updated 5 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆118Updated last month
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆147Updated last year
- A collection of resources and papers on AI Scientist / Robot Scientist☆120Updated 3 months ago
- Official Implementation of the Baby-AIGS system☆24Updated last year
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- This repository contains ScholarQABench data and evaluation pipeline.☆93Updated 5 months ago
- ☆88Updated 2 months ago
- Optimize Any User-defined Compound AI Systems☆66Updated 5 months ago
- [ICML 2025] ResearchTown: Simulator of Human Research Community☆191Updated this week
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆89Updated last month
- Interpretable Contrastive Monte Carlo Tree Search Reasoning☆49Updated last year
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆124Updated 7 months ago
- A benchmark that challenges language models to code solutions for scientific problems☆166Updated last week
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆240Updated 7 months ago
- Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"☆69Updated last year
- ☆227Updated 10 months ago
- This is a survey of research on AI scientists, AI researchers, AI engineers, and a series of AI-driven research studies☆168Updated 2 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆44Updated 11 months ago
- The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)☆37Updated last year
- A banchmark list for evaluation of large language models.☆156Updated this week
- LLM for Scientific Research Survey☆118Updated 11 months ago
- This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…☆101Updated 2 months ago