☆128Apr 1, 2026Updated 6 months ago
Alternatives and similar repositories for terminal-bench-pro
Users that are interested in terminal-bench-pro are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-agent synthetic data generation pipeline capable of generating and validating long horizon terminal/coding tasks for RL training☆75Jul 28, 2025Updated last year
- ☆25Jun 18, 2026Updated 4 months ago
- A construction kit for reinforcement learning environment management.☆490Updated this week
- A curated list of awesome Harbor ecosystem projects☆59May 29, 2026Updated 4 months ago
- Convert GitHub PRs into Harbor tasks☆89Jul 13, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆76Mar 24, 2026Updated 7 months ago
- 💻 SETA: Scaling Environments for Terminal Agents - Environments☆150Feb 16, 2026Updated 8 months ago
- SWE-Bench-plus-plus☆26Feb 5, 2026Updated 8 months ago
- ☆432Apr 30, 2026Updated 5 months ago
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆507Aug 18, 2026Updated 2 months ago
- ☆148Mar 31, 2026Updated 6 months ago
- GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…☆416Aug 24, 2025Updated last year
- ☆18Aug 6, 2026Updated 2 months ago
- ☆19Oct 15, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Public agent skills catalog for Harbor☆14May 12, 2026Updated 5 months ago
- A benchmark for LLMs on complicated tasks in the terminal☆2,612Jul 11, 2026Updated 3 months ago
- Benchmark harness and code for "SWE-fficiency: Can Language Models Optimize Real World Repositories on Real World Workloads?"☆27Feb 17, 2026Updated 8 months ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆32Mar 5, 2024Updated 2 years ago
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆25Sep 26, 2024Updated 2 years ago
- ☆31Apr 7, 2026Updated 6 months ago
- Terminal-Bench 2.1☆129Sep 19, 2026Updated last month
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆260Sep 25, 2026Updated last month
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆235Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- General Agent Benchmark for OpenClaw, made by Qwen Team, Alibaba Group.☆62Jun 10, 2026Updated 4 months ago
- 💻 SETA: Scaling Environments for Terminal Agents☆191Sep 30, 2026Updated 3 weeks ago
- A compact high-signal benchmark for evaluating frontier agents☆42Aug 3, 2026Updated 2 months ago
- This is the office repository for ACL 2024 paper "Learning or Self-aligning? Rethinking Instruction Fine-tuning"☆11Aug 11, 2024Updated 2 years ago
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment☆18Dec 19, 2024Updated last year
- An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models☆3,440Updated this week
- Optimal stopping package for LLM evaluations☆25Sep 13, 2026Updated last month
- Designing effective multimodal environment distributions beyond simply environment scaling.☆16Aug 4, 2026Updated 2 months ago
- Benchmarking Agents on Real-World Terminal Tasks☆51May 31, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This is an official code for the paper: TestExplora: Benchmarking LLMs for Proactive Bug Discovery via Repository-Level Test Generation☆16Mar 26, 2026Updated 7 months ago
- An open-source framework to benchmark and assess safety specifications of Reinforcement Learning problems.☆14Aug 25, 2023Updated 3 years ago
- Benchmarking Language Agents Under Controllable and Extreme Context Growth☆63Apr 29, 2026Updated 5 months ago
- Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity☆16May 7, 2026Updated 5 months ago
- ☆55Oct 28, 2025Updated 11 months ago
- Harbor agent adapter for pi coding agent to run Terminal-Bench evaluations☆32Dec 1, 2025Updated 10 months ago
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆367Dec 18, 2025Updated 10 months ago