AIRS-Bench: an AI Research Science benchmark for quantifying the end-to-end AI research abilities of LLM agents
☆105May 5, 2026Updated 2 months ago
Alternatives and similar repositories for airs-bench
Users that are interested in airs-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark and execution environment for evaluating LLM agents on end-to-end AI Research. [ICLR 2026]☆36May 31, 2026Updated 2 months ago
- ☆10Apr 16, 2024Updated 2 years ago
- ☆126Updated this week
- Official code and dataset for our paper: RefineBench: Evaluating Refinement Capability of Language Models via Checklists☆17Dec 1, 2025Updated 8 months ago
- AIRA-dojo: a framework for developing and evaluating AI research agents☆156Apr 14, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An Open-Ended Agentic Simulator☆61Aug 11, 2024Updated last year
- 🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery☆231Updated this week
- [NeurIPS 2025 spotlight] Mitigating the AI Safety Impact of Multi-Agent Scaffolds☆19Sep 22, 2025Updated 10 months ago
- Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)☆15Sep 28, 2024Updated last year
- Official repository for "Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models", https://arxiv.org/abs/2601.1983…☆100Mar 9, 2026Updated 4 months ago
- ☆15Apr 15, 2026Updated 3 months ago
- The official implementation of "Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding"☆22Jun 26, 2025Updated last year
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆151Jul 18, 2026Updated 2 weeks ago
- Official Repo: AutoResearchBench: Benchmarking AI Agents on Complex Scientific Literature Discovery☆60Apr 24, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Model souping for LLMs☆73Nov 18, 2025Updated 8 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆145May 6, 2026Updated 2 months ago
- Scalable Option Learning☆24Updated this week
- labbench2☆54May 7, 2026Updated 2 months ago
- [EACL 2026] PaperSearchQA. Data generation pipeline for QA over scientific papers, suitable for RL training search agents☆35Feb 4, 2026Updated 6 months ago
- [ICLR26] Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs☆24Apr 8, 2026Updated 3 months ago
- This repository contains the code and data for the paper "Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents wit…☆72Apr 8, 2026Updated 3 months ago
- ☆613May 24, 2026Updated 2 months ago
- A framework for few-shot evaluation of language models.☆16Oct 14, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆136Mar 31, 2026Updated 4 months ago
- Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision☆170Feb 6, 2026Updated 5 months ago
- [ICLR 2026] LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discovery☆17May 10, 2026Updated 2 months ago
- [ICLR 2026] A framework to "create benchmarks" and "evaluate AI co-scientists" in experimental data-driven real-world scientific research…☆16Feb 16, 2026Updated 5 months ago
- YSC 2023 Papers: A complete collection of research papers, code and data from the International Young Scientists Conference 2023 for youn…☆12Jan 17, 2024Updated 2 years ago
- ☆101Oct 30, 2025Updated 9 months ago
- Awesome-Parallel-Reasoning: Unlocking the reasoning potential of LLMs. Papers, Code, Resources & Survey.☆55Mar 8, 2026Updated 4 months ago
- Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge☆132May 24, 2026Updated 2 months ago
- Local-first platform for managing research projects, vibe coding and vibe research.☆26Mar 13, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation of the paper "Improving Multi-step RAG with Hypergraph-based Memory for Long-context Complex Relational Modeling"☆131Jan 22, 2026Updated 6 months ago
- ☆10Nov 6, 2024Updated last year
- [ICLR26] AI-based scaling law discovery☆31Jan 30, 2026Updated 6 months ago
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph☆18Oct 13, 2024Updated last year
- Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM | EMNLP 2025 Findings☆18Oct 17, 2025Updated 9 months ago
- Basic IMDB Parser with a nice MIT license☆13Dec 29, 2019Updated 6 years ago
- The original Shared Recurrent Memory Transformer implementation☆36Jul 11, 2025Updated last year