OSU-NLP-Group / ScienceAgentBenchLinks
[ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
☆89Updated 2 weeks ago
Alternatives and similar repositories for ScienceAgentBench
Users that are interested in ScienceAgentBench are comparing it to the libraries listed below
Sorting:
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆95Updated 2 weeks ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated 5 months ago
- Official Implementation of the Baby-AIGS system☆23Updated 7 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated 7 months ago
- Discovering Data-driven Hypotheses in the Wild☆94Updated 2 weeks ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆62Updated last month
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆108Updated 8 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆138Updated 7 months ago
- This repository contains ScholarQABench data and evaluation pipeline.☆72Updated 2 months ago
- ☆53Updated last week
- A benchmark that challenges language models to code solutions for scientific problems☆123Updated this week
- A curated list of papers on LLMs and agents for scientific research and development☆61Updated 6 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆86Updated 2 months ago
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆77Updated 2 months ago
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆59Updated 5 months ago
- official implementation of paper "Process Reward Model with Q-value Rankings"☆59Updated 4 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆93Updated 2 weeks ago
- A virtual environment for developing and evaluating automated scientific discovery agents.☆161Updated 3 months ago
- ☆122Updated 11 months ago
- ☆32Updated last month
- Code, benchmark and environment for "ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows"☆71Updated last week
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆80Updated last year
- A collection of resources and papers on AI Scientist / Robot Scientist☆73Updated 3 weeks ago
- Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering☆59Updated 6 months ago
- ☆48Updated 2 weeks ago
- [ICLR 2025]ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning☆57Updated 3 months ago
- ☆65Updated 2 months ago
- The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)☆31Updated last year
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆100Updated 4 months ago