Alternatives and similar repositories for SWE-PolyBench

Users that are interested in SWE-PolyBench are comparing it to the libraries listed below

• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆51Updated 5 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆246Updated last week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆430Updated this week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆538Updated this week
• princeton-pli / hal-harness
  ☆223Updated this week
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆542Updated this week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆293Updated last week
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆79Updated last year
• aorwall / moatless-tree-search
  ☆132Updated 8 months ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆476Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆328Updated 3 months ago
• google / lmeval
  ☆237Updated 2 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆199Updated last week
• ScalingIntelligence / codemonkeys
  ☆59Updated last year
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆116Updated 2 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆106Updated last year
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆116Updated last year
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆130Updated 4 months ago
• bigcode-project / bigcodebench
  [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
  ☆475Updated last month
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆259Updated last month
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆119Updated 9 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• open-thoughts / OpenThoughts-Agent
  Data recipes and robust infrastructure for training AI agents
  ☆94Updated this week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆244Updated last year
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆1,494Updated 2 weeks ago
• gso-bench / gso
  [NeurIPS '25] GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
  ☆63Updated this week
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆717Updated last week
• apple / ToolSandbox
  ☆236Updated 3 months ago
• PrimeIntellect-ai / genesys
  ☆137Updated 10 months ago