Alternatives and similar repositories for SWE-Perf

Users that are interested in SWE-Perf are comparing it to the libraries listed below

• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆79Updated last year
• princeton-pli / LongProc
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆26Updated last month
• newfacade / LeetCodeDataset
  LeetCode Training and Evaluation Dataset
  ☆30Updated 3 months ago
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆136Updated 3 weeks ago
• Hambaobao / SWE-Flow
  SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner
  ☆23Updated last month
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆159Updated last week
• microsoft / SWE-bench-Live
  🚀 SWE-bench Goes Live!
  ☆104Updated last week
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆166Updated 2 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆62Updated 10 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆114Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆105Updated 2 months ago
• SparksofAGI / MHPP
  ☆32Updated last month
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆243Updated 3 months ago
• hanxuhu / SeqIns
  The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…
  ☆29Updated 8 months ago
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆64Updated 2 months ago
• OS-Copilot / ScienceBoard
  Code, benchmark and environment for "ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific Workflows"
  ☆100Updated last month
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆85Updated 7 months ago
• CodeEditorBench / CodeEditorBench
  ☆51Updated last year
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆47Updated 6 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 11 months ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆22Updated 7 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆61Updated 8 months ago
• ekwinox117 / multi-challenge
  ☆41Updated 6 months ago
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆110Updated 7 months ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆111Updated last year
• TianHongZXY / RLVR-Decomposed
  Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"
  ☆83Updated 3 weeks ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆76Updated 4 months ago
• multimodal-art-projection / KORGym
  ☆45Updated 2 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆93Updated 9 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆156Updated last month