A benchmark for evaluating AI agents on frontier ultra long-horizon auto research tasks.
☆170Aug 30, 2026Updated last month
Alternatives and similar repositories for autolab
Users that are interested in autolab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆36May 15, 2026Updated 5 months ago
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆19Oct 9, 2026Updated 2 weeks ago
- Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Prompts☆26Feb 23, 2024Updated 2 years ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆602Oct 2, 2026Updated 3 weeks ago
- A unified framework for vision-language environments with Gymnasium-compatible interface☆38Mar 17, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆61May 25, 2026Updated 4 months ago
- A framework for object-oriented agents. A minimalist agent framework with maximal expressivity.☆76Updated this week
- ☆16May 15, 2026Updated 5 months ago
- ☆123Oct 6, 2026Updated 2 weeks ago
- Universal text artifact optimizer using LLM-powered iterative search☆20Mar 3, 2026Updated 7 months ago
- Open-source autoresearch powered by autonomous coding agents. Run Claude Code, OpenCode, and Codex with grading, shared knowledge, and mu…☆1,090Updated this week
- AutoGEPA automates the tedious parts of setting up a DSPy optimization pipeline: converting raw data into dspy.Examples, generating a met…☆19Jul 4, 2026Updated 3 months ago
- Repository for TRACE: Capability-Targeted Agentic Training☆124Jul 12, 2026Updated 3 months ago
- ☆28Aug 27, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Terrarium: Multi-turn data engine for evaluating and optimizing LLM agents in living environments.☆60Jul 14, 2026Updated 3 months ago
- [NeurIPS 2026] Official codebase for the paper "WorldMemArena: Evaluating Multimodal Agent Memory Through Action–World Interaction"☆30May 29, 2026Updated 4 months ago
- An exploration to always on proactive memory. Design Philosophy — "imperfection by design"☆62Aug 25, 2026Updated last month
- Official eval scripts for JobBench☆64Oct 6, 2026Updated 2 weeks ago
- codebase for the paper Tail-Likelihood Reinforcement Learning☆18Sep 11, 2026Updated last month
- RSI Bench is an ongoing effort to evaluate whether AI agents can develop the capabilities required to advance AI R&D.☆94Updated this week
- ☆50Jun 7, 2025Updated last year
- Reproducing R1 for Code with Reliable Rewards☆13Apr 9, 2025Updated last year
- [ EMNLP 2025 ] M3Retrieve is a multimodal benchmark for healthcare data . We have done rigorous evaluation of different multimodal retrie…☆14Nov 4, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Lossless-first prompt compression for JSON, YAML, CSV, and Markdown. Library, CLI, MCP server, desktop app, and browser extension.☆20Sep 29, 2026Updated 3 weeks ago
- Your efficient and accurate answer verification system for RL training.☆41Jun 23, 2025Updated last year
- OpenRouter for agents and sandbox environments. Provides a control plane and configuration options for persistent agent workers. Route ru…☆30Oct 16, 2026Updated last week
- Benchmark harness for evaluating DSPy RLMs on data analysis tasks (InfiAgent-DABench)☆24Mar 22, 2026Updated 7 months ago
- ☆41Aug 21, 2026Updated 2 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆232Nov 27, 2025Updated 10 months ago
- Official code for Meta-Harness (2603.28052)☆1,691Oct 2, 2026Updated 3 weeks ago
- ☆27Feb 26, 2026Updated 7 months ago
- [Arxiv 2025] ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motions☆45Jun 11, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- UQ: Assessing Language Models on Unsolved Questions☆30Aug 26, 2025Updated last year
- Official repository for AutoRule: Reasoning Chain-of-thought Extracted Rule-based Rewards Improve Preference Learning☆17Jul 24, 2025Updated last year
- ☆18Jun 3, 2025Updated last year
- [ICML 2026] InftyThink+: Effective and Efficient Infinite-Horizon Reasoning via Reinforcement Learning☆34May 25, 2026Updated 4 months ago
- ☆276Updated this week
- Overflow Prevention Enhances Long-Context Recurrent LLMs (COLM 2025)☆18Jul 8, 2025Updated last year
- Official Implementation of Trajectory-Refined Distillation☆38Jun 9, 2026Updated 4 months ago