Alternatives and similar repositories for SWE-PolyBench

Users that are interested in SWE-PolyBench are comparing it to the libraries listed below

• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆213Updated this week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆396Updated this week
• princeton-pli / hal-harness
  ☆207Updated last week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆487Updated this week
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆228Updated last week
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆47Updated 4 months ago
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆549Updated last week
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆164Updated 8 months ago
• google / lmeval
  ☆235Updated 3 weeks ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆360Updated this week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆286Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆190Updated 9 months ago
• PrimeIntellect-ai / prime-environments
  Curated collection of community environments
  ☆195Updated last week
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆604Updated last month
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆241Updated 2 weeks ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆233Updated last month
• aorwall / moatless-tree-search
  ☆128Updated 6 months ago
• pyember / ember
  ☆234Updated 5 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆118Updated 7 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆239Updated last year
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆114Updated last year
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆1,235Updated this week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆115Updated 2 weeks ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆601Updated 4 months ago
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆123Updated 2 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆198Updated last year
• PrimeIntellect-ai / genesys
  ☆136Updated 9 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆79Updated 2 months ago
• chroma-core / context-rot
  This repository contains the toolkit for replicating results from our technical report.
  ☆181Updated 3 months ago