AIRA-dojo: a framework for developing and evaluating AI research agents
☆164Apr 14, 2026Updated 4 months ago
Alternatives and similar repositories for aira-dojo
Users that are interested in aira-dojo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆145May 6, 2026Updated 3 months ago
- Reward Evolution with Large Language Models using Human Feedback☆20Aug 24, 2026Updated last week
- The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignm…☆14Sep 7, 2023Updated 2 years ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,733Apr 24, 2026Updated 4 months ago
- The official implementation of "ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoning"☆447Mar 29, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CATransformers is a framework for joint neural network and hardware architecture search.☆24Mar 17, 2026Updated 5 months ago
- ☆105Oct 30, 2025Updated 10 months ago
- Implementation of the Decrypto benchmark for multi-agent reasoning and theory of mind.☆23Jan 19, 2026Updated 7 months ago
- MARS, a framework optimized for autonomous AI research☆41May 19, 2026Updated 3 months ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆621Aug 10, 2025Updated last year
- AIDE: an LLM agent for machine learning engineering - the research Weco grew out of. Referenced in OpenAI MLE-bench.☆1,500Updated this week
- ☆17Aug 26, 2025Updated last year
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆550Aug 26, 2026Updated last week
- ☆144Mar 31, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- AIRS-Bench: an AI Research Science benchmark for quantifying the end-to-end AI research abilities of LLM agents☆113May 5, 2026Updated 3 months ago
- A research framework for evaluating proactive AI assistants through active user simulation☆39May 23, 2026Updated 3 months ago
- Library for sequence-to-sequence numeric prediction, applicable to any tokenizable input, and allows pretraining and fine-tuning over mul…☆354Updated this week
- Official implementation of DiscoGen, for "Procedural Generation of Algorithm Discovery Tasks in Machine Learning"☆50Updated this week
- ☆27Jun 22, 2026Updated 2 months ago
- Follow-Up Differential Descriptions: Language Models Resolve Ambiguities for Image Classification☆11Nov 15, 2023Updated 2 years ago
- ☆159Oct 16, 2025Updated 10 months ago
- ☆21May 4, 2026Updated 4 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆719Mar 16, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆545Updated this week
- AI Co-Scientist is a comprehensive multi-agent AI system designed for scientific research and hypothesis generation.☆21Mar 4, 2025Updated last year
- Project overview, roadmap and initial result reports☆11Aug 6, 2022Updated 4 years ago
- Propose & vote on reading group papers in the "Discussions" tab.☆12Feb 20, 2024Updated 2 years ago
- ☆22Jan 29, 2026Updated 7 months ago
- If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions☆17Apr 4, 2024Updated 2 years ago
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- ☆10Nov 15, 2023Updated 2 years ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆290Aug 5, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Sep 16, 2025Updated 11 months ago
- Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)☆16Sep 28, 2024Updated last year
- Discovering Data-driven Hypotheses in the Wild☆160Jun 9, 2025Updated last year
- Implementation of SOAR☆56Sep 17, 2025Updated 11 months ago
- Code for ExploreTom☆93Jun 25, 2025Updated last year
- Quantize transformers to any learned arbitrary 4-bit numeric format☆59Jul 2, 2026Updated 2 months ago
- Production-Grade Autoresearch. Ideal for agent harness engineering, prompt engineering, ML model development, GPU kernels, and other opti…☆94Updated this week