A benchmark for evaluating AI agents on realistic business workflows
☆352Aug 4, 2026Updated 2 months ago
Alternatives and similar repositories for AutomationBench
Users that are interested in AutomationBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official eval scripts for JobBench☆64Oct 6, 2026Updated 2 weeks ago
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆504Aug 18, 2026Updated 2 months ago
- Toolathlon-Gym for testing AI agents real-world tool-use capabilities across diverse MCP servers.☆151Oct 1, 2026Updated 3 weeks ago
- Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification☆23Oct 8, 2025Updated last year
- Measuring and evolving with the frontier of agent work☆952Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Benchmark self-evolving Agent upon realistic large-scale file workspaces☆81Aug 27, 2026Updated last month
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆468Sep 20, 2026Updated last month
- ☆60Sep 25, 2026Updated 3 weeks ago
- ☆21Jul 21, 2026Updated 3 months ago
- RSI Bench is an ongoing effort to evaluate whether AI agents can develop the capabilities required to advance AI R&D.☆94Updated this week
- RL-training knowledge-work agents on APEX-Agents data with SkyRL + Harbor☆217Sep 1, 2026Updated last month
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆235Updated this week
- ☆123Oct 6, 2026Updated 2 weeks ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆602Oct 2, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- SWE-Marathon: an ultra long-horizon SWE benchmark☆169Updated this week
- Rethinking the Evaluation of Harness Evolution for Agents☆44Oct 15, 2026Updated last week
- Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains☆752Updated this week
- Codebase for EnterpriseOps-Gym from ServiceNow☆138Oct 6, 2026Updated 2 weeks ago
- Repository for getting started with the OfficeQA Benchmark.☆203Aug 6, 2026Updated 2 months ago
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆84Updated this week
- [Neurips 2026] SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows☆43Updated this week
- ☆38Oct 6, 2026Updated 2 weeks ago
- ☆30Aug 12, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆25Jun 18, 2026Updated 4 months ago
- ☆147Sep 30, 2026Updated 3 weeks ago
- Samaya AI's FrontierFinance Benchmark Grader☆26Oct 15, 2026Updated last week
- Harness for running and evaluating AI agents against RL environments☆291Updated this week
- RSI-Exam: Measuring Recursive Self-Improvement on Long-Horizon, Executable Research Tasks · Discord https://discord.gg/FBzhepyE☆189Updated this week
- Fast, flexible, elastically deterministic data loading for foundation model training☆81Updated this week
- Can Language Models Rebuild Programs From Scratch?☆970Oct 12, 2026Updated last week
- Framework for evaluating and improving agents☆6,335Updated this week
- ☆41Aug 21, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆44Sep 21, 2026Updated last month
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆22Nov 22, 2025Updated 11 months ago
- A benchmark for general-purpose terminal-use agents.☆49Oct 3, 2026Updated 2 weeks ago
- τ²-Bench-Verified is a corrected and verified version of the original τ²-bench benchmark. This release addresses issues discovered in the…☆56Apr 2, 2026Updated 6 months ago
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆335Updated this week
- MCP Atlas☆162Oct 14, 2026Updated last week
- Measuring frontier coding agents on original, long-horizon engineering tasks☆1,857Aug 26, 2026Updated last month