Alternatives and similar repositories for asta-bench

Users that are interested in asta-bench are comparing it to the libraries listed below

• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆124Updated 7 months ago
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆118Updated 4 months ago
• allenai / agent-baselines
  ☆102Updated last month
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆42Updated last year
• princeton-pli / hal-harness
  ☆209Updated 2 weeks ago
• yale-nlp / SciArena
  Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"
  ☆55Updated 5 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆173Updated last week
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆93Updated 4 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated 3 weeks ago
• snap-stanford / optimas
  Optimize Any User-defined Compound AI Systems
  ☆65Updated 4 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago
• MLE-Dojo / MLE-Dojo
  ☆88Updated 2 months ago
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆198Updated 10 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆231Updated 7 months ago
• pgasawa / BARE
  Leveraging Base Language Models for Few-Shot Synthetic Data Generation
  ☆40Updated 2 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated last year
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 7 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆165Updated 2 weeks ago
• OSU-NLP-Group / awesome-agents4science
  A curated list of papers on LLMs and agents for scientific research and development
  ☆80Updated last year
• allenai / infinigram-api
  ☆92Updated 3 weeks ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆43Updated 7 months ago
• guestrin-lab / deepscholar-bench
  benchmark and evaluate generative research synthesis
  ☆103Updated this week
• spcl / x1
  Official Implementation of "Reasoning Language Models: A Blueprint"
  ☆94Updated 5 months ago
• GAIR-NLP / MegaScience
  MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning
  ☆110Updated last month
• vsubramaniam851 / multiagent-ft
  ☆226Updated 10 months ago
• gersteinlab / ChemAgent
  [ICLR 2025]ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning https://arxiv.org/abs/2501.06590
  ☆78Updated 5 months ago
• ChicagoHAI / hypothesis-generation
  This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…
  ☆99Updated last month
• facebookresearch / aira-dojo
  AIRA-dojo: a framework for developing and evaluating AI research agents
  ☆122Updated last month
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆190Updated 10 months ago