A benchmark for evaluating AI agents on realistic business workflows
☆216Aug 4, 2026Updated 2 weeks ago
Alternatives and similar repositories for AutomationBench
Users that are interested in AutomationBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Toolathlon-Gym for testing AI agents real-world tool-use capabilities across diverse MCP servers.☆145Jul 22, 2026Updated last month
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆461Updated this week
- Official eval scripts for JobBench☆38Aug 5, 2026Updated 2 weeks ago
- A benchmark for general-purpose terminal-use agents.☆46Aug 7, 2026Updated 2 weeks ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆528Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Terminal-Bench-Science: Evaluating AI Agents on Complex Real-World Scientific Workflows in the Terminal☆273Updated this week
- Measuring and evolving with the frontier of agent work☆533Updated this week
- ☆23Jun 18, 2026Updated 2 months ago
- A curated list of awesome Harbor ecosystem projects☆52May 29, 2026Updated 2 months ago
- ☆104Aug 14, 2026Updated last week
- ☆44Jun 17, 2026Updated 2 months ago
- MCP Atlas☆148Aug 12, 2026Updated last week
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆50May 30, 2026Updated 2 months ago
- Harness for running and evaluating AI agents against RL environments☆242Aug 11, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world MCP use.☆459Jun 12, 2026Updated 2 months ago
- ☆19Mar 25, 2026Updated 4 months ago
- Benchmarking Language Agents Under Controllable and Extreme Context Growth☆54Apr 29, 2026Updated 3 months ago
- Codebase for EnterpriseOps-Gym from ServiceNow☆120Updated this week
- SWE-Marathon: an ultra long-horizon SWE benchmark☆138Updated this week
- Approximating the joint distribution of language models via MCTS☆22Nov 3, 2024Updated last year
- τ²-Bench-Verified is a corrected and verified version of the original τ²-bench benchmark. This release addresses issues discovered in the…☆51Apr 2, 2026Updated 4 months ago
- Reproducing R1 for Code with Reliable Rewards☆13Apr 9, 2025Updated last year
- LLM RL envs done right, plus some training code☆17Feb 1, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆32Jun 16, 2024Updated 2 years ago
- The place for RIZZ☆12Mar 10, 2025Updated last year
- ☆29Apr 30, 2024Updated 2 years ago
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆215Aug 13, 2026Updated last week
- ☆139Mar 20, 2025Updated last year
- A field guide for go to market teams using coding agents. Installable skills for campaign planning, CRM context, customer proof, and revi…☆326Jul 13, 2026Updated last month
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆302Updated this week
- [EMNLP-2025] R1-Zero on ANY TASK☆32Nov 9, 2025Updated 9 months ago
- Benchmarking multimodal agents on realistic, ultra-challenging visual scenarios requiring long-horizon hybrid tool use.☆72Mar 10, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ACL'25 Findings] Official repo for "HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task"☆40Apr 7, 2025Updated last year
- Data recipes and robust infrastructure for training AI agents☆282Updated this week
- Realistic examples of building evals and optimizing agents with Harbor☆184Apr 23, 2026Updated 4 months ago
- A lightweight, high-performance AI/RAG workspace and autonomous agent framework implemented in Go. Inspired by the Leann RAG backend arch…☆36Aug 17, 2026Updated last week
- 🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts☆40Sep 29, 2024Updated last year
- Terminal-Bench 2.1☆82Updated this week
- New testbed of interactive SWE tasks for coding agents, set in a realistic multi-turn developer driven environment☆24Jun 30, 2026Updated last month