A benchmark for evaluating AI agents on frontier ultra long-horizon auto research tasks.
☆172Aug 30, 2026Updated 2 months ago
Alternatives and similar repositories for autolab
Users that are interested in autolab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Final research artifacts from Épi: 106 improved constructions, 15 mathematical results, and their certificates.☆14Sep 14, 2026Updated last month
- ☆38May 15, 2026Updated 5 months ago
- https://huggingface.co/spaces/WildVision/vision-arena☆13Nov 9, 2024Updated 2 years ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆620Updated this week
- Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Prompts☆26Feb 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆16May 15, 2026Updated 5 months ago
- A unified framework for vision-language environments with Gymnasium-compatible interface☆38Mar 17, 2026Updated 7 months ago
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆24Oct 9, 2026Updated last month
- ☆128Oct 6, 2026Updated last month
- FabScore: Fine-Grained Evaluation of Fabrications in Automated AI Research☆23Sep 8, 2026Updated 2 months ago
- Open-source autoresearch powered by autonomous coding agents. Run Claude Code, OpenCode, and Codex with grading, shared knowledge, and mu…☆1,128Oct 19, 2026Updated 3 weeks ago
- ☆334Updated this week
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆477Updated this week
- ☆20Aug 17, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- BenchRouter - Benchmark routing and evaluation framework☆13May 23, 2026Updated 5 months ago
- Executable, measurable, and reproducible AI4AI toward recursive self-improvement. Home of OpenMLE and Frontis-MA1.☆893Sep 17, 2026Updated last month
- 🦞 ClawMark: A Living-World Benchmark for Multi-Day, Multimodal Coworker Agents☆126May 28, 2026Updated 5 months ago
- Terrarium: Multi-turn data engine for evaluating and optimizing LLM agents in living environments.☆62Jul 14, 2026Updated 3 months ago
- [EMNLP‘2026 Main] VGI-Bench: Probing Visual Intelligence in Video Generative Models☆89Oct 24, 2026Updated 2 weeks ago
- The official github repo for "Training Optimal Large Diffusion Language Models", the first-ever large-scale diffusion language models sca…☆46Nov 6, 2025Updated last year
- Repository for TRACE: Capability-Targeted Agentic Training☆128Jul 12, 2026Updated 3 months ago
- [NeurIPS 2025] A Comprehensive Benchmark for Perspective Perception, Reasoning, and Robustness☆14Oct 27, 2026Updated 2 weeks ago
- Lossless-first prompt compression for JSON, YAML, CSV, and Markdown. Library, CLI, MCP server, desktop app, and browser extension.☆20Oct 30, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [DiffuAgent] The Bitter Lesson of Diffusion Language Models for Agentic Workflows☆14Jan 30, 2026Updated 9 months ago
- CoDA is a multi-agent framework that turns natural language queries into publication-quality visualizations.☆43Mar 20, 2026Updated 7 months ago
- Your efficient and accurate answer verification system for RL training.☆41Jun 23, 2025Updated last year
- Benchmark harness for evaluating DSPy RLMs on data analysis tasks (InfiAgent-DABench)☆24Mar 22, 2026Updated 7 months ago
- ☆16Jul 17, 2026Updated 3 months ago
- The official repository of ALE-Bench☆236Updated this week
- RSIGym: A Flexible Environment for Recursive Self-Improvement☆144Nov 3, 2026Updated last week
- Official code for Meta-Harness (2603.28052)☆1,775Updated this week
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆233Nov 27, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- UQ: Assessing Language Models on Unsolved Questions☆30Aug 26, 2025Updated last year
- RiskLab (ACL 2026 Demo): A Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems☆33Sep 30, 2026Updated last month
- [Arxiv 2025] ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motions☆45Jun 11, 2025Updated last year
- This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]☆83Jul 1, 2025Updated last year
- RLAnything (ICML 2026) & AutoTool (ICML 2026), DemyAgent: Open-Source RL for LLMs and Agentic Scenarios☆661Jun 12, 2026Updated 5 months ago
- A framework for object-oriented agents. A minimalist agent framework with maximal expressivity.☆80Oct 25, 2026Updated 2 weeks ago
- Agentic RL on Any Harness at Scale☆875Oct 30, 2026Updated last week
Are these results useful?