Alternatives and similar repositories for refact-bench

Users that are interested in refact-bench are comparing it to the libraries listed below

• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆78Updated last year
• aorwall / moatless-tree-search
  ☆124Updated 5 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆217Updated last week
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆44Updated 3 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆376Updated this week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆277Updated this week
• THUDM / SWE-Dev
  [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.
  ☆56Updated 4 months ago
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆230Updated 7 months ago
• microsoft / CodePlan
  Data and evaluation scripts for "CodePlan: Repository-level Coding using LLMs and Planning", FSE 2024
  ☆77Updated last year
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆193Updated 11 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆102Updated last year
• FSoft-AI4Code / RepoHyper
  [FORGE 2025] Graph-based method for end-to-end code completion with context awareness on repository
  ☆68Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆93Updated last month
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆114Updated last year
• nuprl / CanItEdit
  Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
  ☆48Updated 2 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆114Updated 2 months ago
• NEUIR / INTERVENOR
  Source code for paper: INTERVENOR : Prompt the Coding Ability of Large Language Models with the Interactive Chain of Repairing
  ☆28Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆124Updated last year
• codelion / pts
  Pivotal Token Search
  ☆131Updated 4 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆224Updated this week
• millix19 / promptmii
  PromptMII: Meta-Learning Instruction Induction for LLMs
  ☆44Updated this week
• Aider-AI / refactor-benchmark
  Aider's refactoring benchmark exercises based on popular python repos
  ☆78Updated last year
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆182Updated 6 months ago
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆467Updated this week
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆80Updated last year
• OpenHands / ToM-SWE
  The theory of mind module for the SWE agent
  ☆40Updated 2 weeks ago
• NL2Code / CodeR
  ☆160Updated last year
• opper-ai / delvin
  Agent fixing SWE bench issues
  ☆19Updated last year
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆135Updated 7 months ago