OSU-NLP-Group / ScienceAgentBenchLinks
[ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
☆88Updated last month
Alternatives and similar repositories for ScienceAgentBench
Users that are interested in ScienceAgentBench are comparing it to the libraries listed below
Sorting:
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆36Updated 5 months ago
- A curated list of papers on LLMs and agents for scientific research and development☆56Updated 5 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆88Updated last week
- This repository contains ScholarQABench data and evaluation pipeline.☆72Updated last month
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆136Updated 6 months ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆61Updated last week
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆41Updated 7 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆81Updated last month
- Discovering Data-driven Hypotheses in the Wild☆85Updated 6 months ago
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆105Updated 7 months ago
- Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty☆79Updated last year
- ☆121Updated 10 months ago
- Official Implementation of the Baby-AIGS system☆23Updated 6 months ago
- The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)☆32Updated last year
- ☆65Updated 2 months ago
- A benchmark that challenges language models to code solutions for scientific problems☆123Updated this week
- ☆49Updated 3 weeks ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆34Updated last year
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆74Updated last month
- official implementation of paper "Process Reward Model with Q-value Rankings"☆59Updated 4 months ago
- Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)☆65Updated last year
- B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners☆82Updated 2 weeks ago
- Interpretable Contrastive Monte Carlo Tree Search Reasoning☆48Updated 6 months ago
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆58Updated 4 months ago
- A virtual environment for developing and evaluating automated scientific discovery agents.☆156Updated 2 months ago
- ☆29Updated 3 weeks ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆89Updated 6 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆36Updated 3 months ago
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆102Updated 4 months ago