A comprehensive code domain benchmark review of LLM researches.
☆248Sep 16, 2026Updated last month
Alternatives and similar repositories for Awesome-Code-Benchmark
Users that are interested in Awesome-Code-Benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Must-read papers on Repository-level Code Generation & Issue Resolution 🔥☆336Oct 21, 2026Updated last week
- Advances and Frontiers of LLM-based Issue Resolution in Software Engineering A Comprehensive Survey☆89Sep 23, 2026Updated last month
- Official Repository for "Training Versatile Coding Agents in Synthetic Environments"☆22Jan 11, 2026Updated 9 months ago
- SWE-Bench-plus-plus☆26Feb 5, 2026Updated 8 months ago
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆261Sep 25, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [TOSEM'25] The official GitHub page for the survey paper "A Survey on Large Language Models for Code Generation".☆205Jul 13, 2025Updated last year
- ☆55Oct 28, 2025Updated last year
- Reproducing R1 for Code with Reliable Rewards☆319May 5, 2025Updated last year
- [TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.☆3,445May 20, 2026Updated 5 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆820Updated this week
- enchmarking Large Language Models' Resistance to Malicious Code☆20Apr 23, 2026Updated 6 months ago
- [FSE'2026] SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarks☆204May 12, 2026Updated 5 months ago
- Official implementation of **LLMs Caught in the Crossfire: Malware Requests and Jailbreak Challenges (ACL 2025)**☆13May 25, 2025Updated last year
- CodeRepoQA dataset☆15Feb 19, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Datasets and code for the CRUST-bench paper.☆42Sep 17, 2026Updated last month
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆754Updated this week
- BERT score for text generation☆12Jan 15, 2025Updated last year
- Official Code of MEnvAgent☆25Feb 3, 2026Updated 8 months ago
- Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…☆14Apr 9, 2025Updated last year
- SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution☆105Sep 24, 2025Updated last year
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆344Jul 13, 2025Updated last year
- ☆12Dec 10, 2025Updated 10 months ago
- ☆30Sep 15, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆367Dec 18, 2025Updated 10 months ago
- AI-assisted verification of Dafny Programs☆21Nov 9, 2025Updated 11 months ago
- A Code Efficiency Benchmark for Code Generation☆16May 26, 2025Updated last year
- Code Efficiency Benchmark☆87Mar 6, 2026Updated 7 months ago
- A tool for finding instruction-level equivalence between two functions.☆16Aug 26, 2025Updated last year
- A continuously updated collection of papers on agentic SE☆639Jul 17, 2026Updated 3 months ago
- [ACL 2025] Graph Aligned Large Language Models for Improved Source Code Understanding☆43May 18, 2025Updated last year
- Sema Code VSCode Extension 是一款基于 Sema Code Core 引擎的 VSCode 智能编程插件，采用事件驱动架构，开发者可通过定制 Subagent 并集成 Skill，实现灵活可插拔的 AI 编程辅助。☆14Updated this week
- ☆24Nov 19, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆68Feb 6, 2026Updated 8 months ago
- MapCoder: Multi-Agent Code Generation for Competitive Problem Solving☆196Feb 12, 2025Updated last year
- Source code for ISSTA'24 paper "AI Coders Are Among Us: Rethinking Programming Language Grammar Towards Efficient Code Generation"☆14Oct 21, 2024Updated 2 years ago
- HumanEvalComm: Evaluating Communication Skill of Code LLM and LLM Agent☆13Feb 8, 2026Updated 8 months ago
- ☆62Apr 12, 2026Updated 6 months ago
- ☆128Jan 9, 2026Updated 9 months ago
- ☆14Jan 7, 2025Updated last year