OSU-NLP-Group / ScienceAgentBenchLinks
[ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
☆117Updated 4 months ago
Alternatives and similar repositories for ScienceAgentBench
Users that are interested in ScienceAgentBench are comparing it to the libraries listed below
Sorting:
- A curated list of papers on LLMs and agents for scientific research and development☆80Updated last year
- Discovering Data-driven Hypotheses in the Wild☆124Updated 6 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆113Updated 5 months ago
- A collection of resources and papers on AI Scientist / Robot Scientist☆117Updated 3 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆114Updated 3 weeks ago
- A virtual environment for developing and evaluating automated scientific discovery agents.☆198Updated 9 months ago
- Official Implementation of the Baby-AIGS system☆24Updated last year
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆139Updated last year
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆230Updated 7 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆87Updated 3 weeks ago
- A benchmark that challenges language models to code solutions for scientific problems☆164Updated last week
- [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆95Updated 4 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated last year
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆38Updated last year
- ☆87Updated 2 months ago
- Optimize Any User-defined Compound AI Systems☆65Updated 4 months ago
- This repository contains ScholarQABench data and evaluation pipeline.☆91Updated 4 months ago
- official implementation of paper "Process Reward Model with Q-value Rankings"☆65Updated 10 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆147Updated last year
- ☆59Updated last week
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆116Updated 6 months ago
- [NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge☆96Updated 2 weeks ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆254Updated 7 months ago
- Process Reward Models That Think☆67Updated last month
- This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…☆97Updated last month
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆102Updated last year
- ☆226Updated 10 months ago
- RL Scaling and Test-Time Scaling (ICML'25)☆112Updated 11 months ago
- 🤝 The code for "Can Large Language Model Agents Simulate Human Trust Behaviors?"☆104Updated 8 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year