AIRS-Bench: an AI Research Science benchmark for quantifying the end-to-end AI research abilities of LLM agents
☆123Oct 10, 2026Updated this week
Alternatives and similar repositories for airs-bench
Users that are interested in airs-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33Apr 16, 2026Updated 5 months ago
- Benchmark and execution environment for evaluating LLM agents on end-to-end AI Research. [ICLR 2026]☆42May 31, 2026Updated 4 months ago
- ☆10Apr 16, 2024Updated 2 years ago
- ☆139Oct 2, 2026Updated last week
- Official code and dataset for our paper: RefineBench: Evaluating Refinement Capability of Language Models via Checklists☆16Dec 1, 2025Updated 10 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- AIRA-dojo: a framework for developing and evaluating AI research agents☆174Apr 14, 2026Updated 5 months ago
- An Open-Ended Agentic Simulator☆61Aug 11, 2024Updated 2 years ago
- 🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery☆267Sep 17, 2026Updated 3 weeks ago
- [NeurIPS 2025 spotlight] Mitigating the AI Safety Impact of Multi-Agent Scaffolds☆20Sep 22, 2025Updated last year
- ☆30May 31, 2026Updated 4 months ago
- Official repository for "Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models", https://arxiv.org/abs/2601.1983…☆101Mar 9, 2026Updated 7 months ago
- The official implementation of "HYPER: A Foundation Model for Inductive Link Prediction with Knowledge Hypergraphs" (ICLR 2026)☆21Mar 25, 2026Updated 6 months ago
- ☆16Apr 15, 2026Updated 5 months ago
- The official implementation of "Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding"☆22Jun 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆177Jul 18, 2026Updated 2 months ago
- Model souping for LLMs☆75Nov 18, 2025Updated 10 months ago
- Official Repo: AutoResearchBench: Benchmarking AI Agents on Complex Scientific Literature Discovery☆72Apr 24, 2026Updated 5 months ago
- Official implementation of Metric Flow Matching (NeurIPS 2024)☆65Aug 14, 2025Updated last year
- GCRL in JAX. Official repository for LEO (ICML 2026).☆34Jun 20, 2026Updated 3 months ago
- Analysis of the CensoredPlanet data.☆20Jun 29, 2025Updated last year
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆146May 6, 2026Updated 5 months ago
- Scalable Option Learning☆27Aug 9, 2026Updated 2 months ago
- ☆26Nov 3, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Data visualization for Inspect AI large language model evalutions.☆23Updated this week
- This repository contains the code and data for the paper "Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents wit…☆75Apr 8, 2026Updated 6 months ago
- [ICLR26] Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs☆25Apr 8, 2026Updated 6 months ago
- ☆644May 24, 2026Updated 4 months ago
- A framework for few-shot evaluation of language models.☆17Oct 14, 2025Updated 11 months ago
- ☆15Jun 18, 2025Updated last year
- The official implementation of "A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge Graphs" (NeurIPS 2023)☆13Sep 1, 2025Updated last year
- ☆147Mar 31, 2026Updated 6 months ago
- An OpenAI API Compatible Honeypot Gateway☆27Mar 17, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ICLR 2026] A framework to "create benchmarks" and "evaluate AI co-scientists" in experimental data-driven real-world scientific research…☆21Sep 14, 2026Updated 3 weeks ago
- Awesome-Parallel-Reasoning: Unlocking the reasoning potential of LLMs. Papers, Code, Resources & Survey.☆57Mar 8, 2026Updated 7 months ago
- Local-first platform for managing research projects, vibe coding and vibe research.☆26Mar 13, 2026Updated 6 months ago
- Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge☆135May 24, 2026Updated 4 months ago
- ☆108Oct 30, 2025Updated 11 months ago
- [ICML 2026] <MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier>☆97May 18, 2026Updated 4 months ago
- Code for "Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoning [EMNLP 2025 Findings]"☆18Aug 27, 2025Updated last year