Alternatives and similar repositories for SWEBench-verified-mini

Users that are interested in SWEBench-verified-mini are comparing it to the libraries listed below

• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆223Updated last year
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆148Updated last month
• Leolty / repobench
  ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024
  ☆170Updated last year
• METR / RE-Bench
  ☆98Updated 4 months ago
• aorwall / SWE-bench-docker
  ☆99Updated last year
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆132Updated last week
• gso-bench / gso
  GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
  ☆37Updated last month
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆152Updated 10 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆114Updated last year
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆119Updated 7 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆206Updated this week
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆62Updated 10 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆130Updated 4 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆238Updated 2 weeks ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆76Updated last month
• aorwall / moatless-tree-search
  ☆105Updated 2 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆72Updated 3 months ago
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆35Updated 9 months ago
• protagolabs / odyssey-math
  ☆84Updated 7 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆89Updated 8 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆155Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆240Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆104Updated last month
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated 11 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆526Updated 3 weeks ago
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆197Updated 9 months ago
• shunzh / Code-AI-Tree-Search
  ☆119Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆89Updated last year
• ryoungj / ObsScaling
  [NeurIPS'24 Spotlight] Observational Scaling Laws
  ☆56Updated 10 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 6 months ago