OSU-NLP-Group / ScienceAgentBenchLinks
[ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
☆103Updated last month
Alternatives and similar repositories for ScienceAgentBench
Users that are interested in ScienceAgentBench are comparing it to the libraries listed below
Sorting:
- Discovering Data-driven Hypotheses in the Wild☆113Updated 4 months ago
- A curated list of papers on LLMs and agents for scientific research and development☆75Updated 9 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆106Updated 2 months ago
- Official Implementation of the Baby-AIGS system☆23Updated 10 months ago
- [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆76Updated last month
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 9 months ago
- A collection of resources and papers on AI Scientist / Robot Scientist☆98Updated last week
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆99Updated last week
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆129Updated 11 months ago
- A virtual environment for developing and evaluating automated scientific discovery agents.☆186Updated 6 months ago
- This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…☆87Updated 2 weeks ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated 11 months ago
- A benchmark that challenges language models to code solutions for scientific problems☆143Updated last week
- This repository contains ScholarQABench data and evaluation pipeline.☆85Updated last month
- ☆74Updated last month
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- [ICML 2025] ResearchTown: Simulator of Human Research Community☆177Updated this week
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆145Updated 10 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆98Updated 10 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆43Updated 7 months ago
- Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"☆63Updated 10 months ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆74Updated 4 months ago
- [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?☆131Updated last year
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆282Updated 2 weeks ago
- official implementation of paper "Process Reward Model with Q-value Rankings"☆63Updated 8 months ago
- 🤝 The code for "Can Large Language Model Agents Simulate Human Trust Behaviors?"☆98Updated 6 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆248Updated last month
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆85Updated last year
- LLM for Scientific Research Survey☆104Updated 8 months ago