AIRS-Bench: an AI Research Science benchmark for quantifying the end-to-end AI research abilities of LLM agents
☆125Oct 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for airs-bench
Users that are interested in airs-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark and execution environment for evaluating LLM agents on end-to-end AI Research. [ICLR 2026]☆43May 31, 2026Updated 5 months ago
- ☆33Sep 21, 2026Updated last month
- AIRA-dojo: a framework for developing and evaluating AI research agents☆179Apr 14, 2026Updated 6 months ago
- Generalised Flow Maps official implementation (ICLR 2026).☆28Oct 30, 2025Updated last year
- 🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery☆276Oct 28, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Apr 16, 2024Updated 2 years ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆181Jul 18, 2026Updated 3 months ago
- ☆653May 24, 2026Updated 5 months ago
- Official code and dataset for our paper: RefineBench: Evaluating Refinement Capability of Language Models via Checklists☆16Dec 1, 2025Updated 11 months ago
- ☆143Oct 27, 2026Updated last week
- Official implementation of DiscoGen, for "Procedural Generation of Algorithm Discovery Tasks in Machine Learning"☆51Sep 16, 2026Updated last month
- Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains☆816Updated this week
- Official code repository for "Into the Unknown: Benchmarking AI agents on open scientific research problems"☆25Oct 20, 2026Updated 2 weeks ago
- [ICML 2026] Principle-Evolvable Scientific Discovery via Uncertainty Minimization☆48Jul 4, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Mar 17, 2026Updated 7 months ago
- ☆11Jul 9, 2021Updated 5 years ago
- A pared-down public clone of the BashArena repo that contains dataset generation code☆16Oct 24, 2026Updated last week
- Large language models, physics-based modeling, experimental measurements: the trinity of data-scarce learning of polymer properties☆15Sep 4, 2025Updated last year
- An Open-Ended Agentic Simulator☆64Aug 11, 2024Updated 2 years ago
- ☆14Oct 27, 2026Updated last week
- ☆62Mar 3, 2026Updated 8 months ago
- Low-rank sparse attention decomposition for LLM interpretability; active development continues in Llamascopium☆30Nov 9, 2025Updated 11 months ago
- PiFlow: Principle-aware Scientific Discovery with Multi-Agent Collaboration☆52Jan 7, 2026Updated 9 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A collection of resources and papers on AI Scientist / Robot Scientist☆178Oct 26, 2026Updated last week
- AIBuildAI Inc☆382Updated this week
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆611Updated this week
- Official implementation of Metric Flow Matching (NeurIPS 2024)☆67Aug 14, 2025Updated last year
- Benchmark Test-Time Scaling of General LLM Agents☆27Apr 14, 2026Updated 6 months ago
- Repository containing the code for Implicit Manifold Gaussian Process.☆16Aug 8, 2024Updated 2 years ago
- [NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents☆94Sep 29, 2026Updated last month
- Analysis of the CensoredPlanet data.☆20Jun 29, 2025Updated last year
- The official implementation of "HYPER: A Foundation Model for Inductive Link Prediction with Knowledge Hypergraphs" (ICLR 2026)☆22Mar 25, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Implementation of the BasePlanE models and the experiments from the NeurIPS 2023 paper "PlanE: Representation Learning over Planar Graphs…☆13Jan 27, 2024Updated 2 years ago
- Claude Code plugin for autonomous AI research — multi-agent loops take a bare topic all the way to running experiments, with no human-wri…☆54Oct 6, 2026Updated 3 weeks ago
- ☆17Feb 27, 2026Updated 8 months ago
- Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)☆16Sep 28, 2024Updated 2 years ago
- Data visualization for Inspect AI large language model evalutions.☆24Updated this week
- A differentiable model of nucleic acid dynamics☆13Dec 1, 2025Updated 11 months ago
- Official Implementation of our AAAI 2025 paper: "Behavior Importance-Aware Graph Neural Architecture Search for Cross-Domain Recommendati…☆10Apr 19, 2025Updated last year