A benchmark for evaluating AI agents on realistic business workflows
☆388Aug 4, 2026Updated 3 months ago
Alternatives and similar repositories for AutomationBench
Users that are interested in AutomationBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆513Aug 18, 2026Updated 2 months ago
- Official eval scripts for JobBench☆73Oct 6, 2026Updated last month
- Toolathlon-Gym for testing AI agents real-world tool-use capabilities across diverse MCP servers.☆152Oct 1, 2026Updated last month
- MCP Atlas☆164Nov 3, 2026Updated last week
- Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification☆23Oct 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆477Updated this week
- Measuring and evolving with the frontier of agent work☆1,039Updated this week
- Codebase for EnterpriseOps-Gym from ServiceNow☆145Oct 26, 2026Updated 2 weeks ago
- Benchmark self-evolving Agent upon realistic large-scale file workspaces☆84Aug 27, 2026Updated 2 months ago
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆238Oct 22, 2026Updated 3 weeks ago
- [NeurIPS 2026] Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agents☆34May 13, 2026Updated 5 months ago
- Reference harness for the Big Finance benchmark of workflow-grounded financial-research questions☆25Oct 19, 2026Updated 3 weeks ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆620Updated this week
- Framework for evaluating and improving agents☆6,973Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆21Jul 21, 2026Updated 3 months ago
- [NeurIPS 2026] An ultra long-horizon SWE benchmark☆177Updated this week
- ☆64Sep 25, 2026Updated last month
- ☆128Oct 6, 2026Updated last month
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆158Oct 9, 2025Updated last year
- Sample-Efficient Parametric Learning from Natural Language☆13Feb 5, 2026Updated 9 months ago
- Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains☆880Updated this week
- The official implementation of "EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesis".☆215Oct 20, 2026Updated 3 weeks ago
- Can Language Models Rebuild Programs From Scratch?☆979Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆2,434Updated this week
- ☆15Mar 12, 2026Updated 8 months ago
- ☆11Sep 24, 2026Updated last month
- A benchmark for general-purpose terminal-use agents.☆48Oct 3, 2026Updated last month
- slime is an LLM training framework for RL Scaling.☆8,814Nov 5, 2026Updated last week
- Benchmarking general AI agents across diverse tasks and environments.☆15Jul 29, 2026Updated 3 months ago
- 🗓️ The hardest life-admin benchmark for agents — lawsuits, escrow shortfalls, apartment hunts, exams. 20 long-horizon tasks × 20–30 stag…☆34Nov 4, 2026Updated last week
- Benchmarking Language Agents Under Controllable and Extreme Context Growth☆67Apr 29, 2026Updated 6 months ago
- Harness for running and evaluating AI agents against RL environments☆301Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆22Aug 14, 2026Updated 2 months ago
- RSI Bench is an ongoing effort to evaluate whether AI agents can develop the capabilities required to advance AI R&D.☆117Updated this week
- [Neurips 2026] SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows☆48Oct 21, 2026Updated 3 weeks ago
- Measuring frontier coding agents on original, long-horizon engineering tasks☆1,899Aug 26, 2026Updated 2 months ago
- RL-training knowledge-work agents on APEX-Agents data with SkyRL + Harbor☆224Sep 1, 2026Updated 2 months ago
- Benchmarking LLMs on Real-World Software Verification in Lean 4☆16Oct 13, 2026Updated 3 weeks ago
- ☆457Nov 5, 2026Updated last week
Are these results useful?