SWE-bench: Can Language Models Resolve Real-world Github Issues?
☆4,676Apr 1, 2026Updated 2 weeks ago
Alternatives and similar repositories for SWE-bench
Users that are interested in SWE-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…☆18,957Apr 6, 2026Updated last week
- Agentless🐱: an agentless approach to automatically solve software development problems☆2,036Dec 22, 2024Updated last year
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆261Mar 29, 2026Updated 2 weeks ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆662Jul 29, 2025Updated 8 months ago
- A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 37.3% tasks (pass@1) in SWE-be…☆3,064Apr 24, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for the paper "Evaluating Large Language Models Trained on Code"☆3,191Jan 17, 2025Updated last year
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆621Updated this week
- 🙌 OpenHands: AI-Driven Development☆71,108Updated this week
- ☆105Jul 17, 2024Updated last year
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆841Jul 16, 2025Updated 9 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆76,536Updated this week
- ☆637Sep 1, 2025Updated 7 months ago
- Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024☆1,713Oct 2, 2025Updated 6 months ago
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆472Apr 6, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software E…☆1,440Jul 18, 2025Updated 8 months ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆25,643Updated this week
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆688Mar 16, 2025Updated last year
- A framework for the evaluation of autoregressive code generation language models.☆1,035Jul 22, 2025Updated 8 months ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆20,603Updated this week
- DSPy: The framework for programming—not prompting—language models☆33,649Updated this week
- ☆4,436Jul 31, 2025Updated 8 months ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆196Aug 16, 2024Updated last year
- A framework for few-shot evaluation of language models.☆12,138Apr 8, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆43,478Updated this week
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,316Feb 8, 2026Updated 2 months ago
- A programming framework for agentic AI☆56,900Apr 6, 2026Updated last week
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆492Jan 3, 2026Updated 3 months ago
- aider is AI pair programming in your terminal☆43,145Apr 9, 2026Updated last week
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asy…☆9,340Updated this week
- Train transformer language models with reinforcement learning.☆18,054Updated this week
- AllenAI's post-training codebase☆3,683Updated this week
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆330Dec 18, 2025Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,472Mar 20, 2026Updated 3 weeks ago
- [TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.☆3,288Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,448Jun 2, 2025Updated 10 months ago
- Enhancing AI Software Engineering with Repository-level Code Graph☆271Apr 1, 2025Updated last year
- Democratizing Reinforcement Learning for LLMs☆5,402Apr 10, 2026Updated last week
- Tools for merging pretrained large language models.☆6,973Mar 15, 2026Updated last month
- Fast and memory-efficient exact attention☆23,344Updated this week