OSU-NLP-Group / ScienceAgentBenchLinks
[ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
☆123Updated 5 months ago
Alternatives and similar repositories for ScienceAgentBench
Users that are interested in ScienceAgentBench are comparing it to the libraries listed below
Sorting:
- A curated list of papers on LLMs and agents for scientific research and development☆84Updated last year
- Official Implementation of the Baby-AIGS system☆24Updated last year
- Discovering Data-driven Hypotheses in the Wild☆128Updated 7 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆120Updated last week
- A virtual environment for developing and evaluating automated scientific discovery agents.☆199Updated 10 months ago
- A collection of resources and papers on AI Scientist / Robot Scientist☆123Updated 4 months ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆143Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆120Updated 2 months ago
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- A benchmark that challenges language models to code solutions for scientific problems☆169Updated last week
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆148Updated last year
- This repository contains ScholarQABench data and evaluation pipeline.☆94Updated 5 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated last year
- Interpretable Contrastive Monte Carlo Tree Search Reasoning☆51Updated last year
- [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆103Updated 5 months ago
- ☆90Updated 3 months ago
- [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction☆87Updated 10 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆94Updated 2 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Updated last year
- official implementation of paper "Process Reward Model with Q-value Rankings"☆65Updated last year
- RL Scaling and Test-Time Scaling (ICML'25)☆112Updated last year
- Resources for our paper: "Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training"☆167Updated 3 months ago
- ☆68Updated 4 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- Process Reward Models That Think☆78Updated 2 months ago
- [ICLR 2025]ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning https://arxiv.org/abs/2501.06590☆80Updated 6 months ago
- B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners☆85Updated 8 months ago
- [NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge☆98Updated last month
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆45Updated 11 months ago
- Code/data for MARG (multi-agent review generation)☆59Updated 4 months ago