Measuring agents' ability to get work done on a computer
☆336Jul 21, 2026Updated this week
Alternatives and similar repositories for frontier-bench
Users that are interested in frontier-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆340Apr 30, 2026Updated 2 months ago
- ☆18Jun 18, 2026Updated last month
- Framework for evaluating and improving agents☆3,348Updated this week
- Terminal-Bench Science: Evaluating AI Agents on Complex Real-World Scientific Workflows in the Terminal☆205Updated this week
- A curated list of awesome Harbor ecosystem projects☆47May 29, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A benchmark for LLMs on complicated tasks in the terminal☆2,479Jul 11, 2026Updated last week
- Terminal-Bench 2.1☆50Updated this week
- SWE-Marathon: an ultra long-horizon SWE benchmark☆111Updated this week
- A compact high-signal benchmark for evaluating frontier agents☆19Updated this week
- Multi-agent synthetic data generation pipeline capable of generating and validating long horizon terminal/coding tasks for RL training☆70Jul 28, 2025Updated 11 months ago
- Data recipes and robust infrastructure for training AI agents☆264Updated this week
- Convert GitHub PRs into Harbor tasks☆72Jul 13, 2026Updated last week
- An agent for auditing repositories of traces for violations of safety properties. Automatically finds cheating (task-level gaming and har…☆15Jun 6, 2026Updated last month
- Realistic examples of building evals and optimizing agents with Harbor☆141Apr 23, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆463Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,086Updated this week
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆433Jul 15, 2026Updated last week
- ☆36May 16, 2026Updated 2 months ago
- 💻 SETA: Scaling Environments for Terminal Agents - Environments☆143Feb 16, 2026Updated 5 months ago
- A Difficulty-Calibrated Benchmark for Building Terminal Agents☆27Feb 20, 2026Updated 5 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆710Updated this week
- SkillsBench evaluates how well skills work and how effective agents are at using them.☆1,559Updated this week
- A benchmark for general-purpose terminal-use agents.☆45Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Repository for results and data (coming soon!) for ClawsBench☆31Apr 8, 2026Updated 3 months ago
- A benchmark for evaluating AI agents on realistic business workflows☆140Updated this week
- Benchmarking Open-Ended Inference Optimization by AI Agents☆32Jul 6, 2026Updated 2 weeks ago
- open source SWE-Atlas☆56Updated this week
- Legacy-Bench: A benchmark for evaluating AI agents on legacy software engineering tasks☆18Apr 2, 2026Updated 3 months ago
- ☆134Mar 31, 2026Updated 3 months ago
- Can Language Models Rebuild Programs From Scratch?☆857Jul 14, 2026Updated last week
- Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections☆21Jul 2, 2026Updated 2 weeks ago
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆189Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Benchmark of LLMs on real open-source projects against dependency hell, legacy toolchains, and complex build systems.☆58Jul 14, 2026Updated last week
- New testbed of interactive SWE tasks for coding agents, set in a realistic multi-turn developer driven environment☆24Jun 30, 2026Updated 3 weeks ago
- Official eval scripts for JobBench☆29Updated this week
- GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…☆398Aug 24, 2025Updated 10 months ago
- slime is an LLM post-training framework for RL Scaling.☆7,594Updated this week
- Training terminal-agents☆239Updated this week
- Toolathlon-Gym for testing AI agents real-world tool-use capabilities across diverse MCP servers.☆140Updated this week