The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
☆92Jul 13, 2024Updated 2 years ago
Alternatives and similar repositories for DebugBench
Users that are interested in DebugBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Nov 1, 2025Updated 11 months ago
- [TOSEM 2026]A Systematic Literature Review on Large Language Models for Automated Program Repair☆248May 1, 2026Updated 5 months ago
- [ICSE'25] Aligning the Objective of LLM-based Program Repair☆23Mar 8, 2025Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆32Mar 5, 2024Updated 2 years ago
- Refactory: Re-factoring based Program Repair applied to Programming Assignments☆44Aug 16, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Large Language Models(LLMs) of Code☆20Apr 23, 2023Updated 3 years ago
- ✅SRepair: Powerful LLM-based Program Repairer with $0.029/Fixed Bug☆79Apr 23, 2026Updated 6 months ago
- Official implementation of our paper "Benchmarking Language Model Creativity: A Case Study on Code Generation"☆14May 16, 2025Updated last year
- LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step (ACL'24)☆588Sep 10, 2024Updated 2 years ago
- This repo is for our submission for ICSE 2025.☆20Jun 12, 2024Updated 2 years ago
- Official implementation: Large Language Models are Interpretable Learners - Google☆13Jun 29, 2024Updated 2 years ago
- Code for EMNLP 2021 Paper "Recall and Learn: A Memory-augmented Solver for Math Word Problems".☆16Oct 20, 2022Updated 4 years ago
- ☆12Mar 4, 2025Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆90Sep 17, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Efficient APR with LLMs http://arxiv.org/pdf/2402.06598☆16May 28, 2024Updated 2 years ago
- Forge-CuTe-Py: A PyTorch-native CuTe DSL kernel laboratory for correctness, benchmarking, and profiling.☆13Feb 8, 2026Updated 8 months ago
- BugsInPy: Benchmarking Bugs in Python Projects☆153Feb 10, 2026Updated 8 months ago
- ☆36May 25, 2023Updated 3 years ago
- An implementation of Tare.☆12Feb 23, 2024Updated 2 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆215Aug 16, 2024Updated 2 years ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆72Aug 15, 2024Updated 2 years ago
- A Reproducible Benchmark of Recent Java Bugs☆54Aug 19, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆18Mar 28, 2026Updated 7 months ago
- ☆28Jun 2, 2026Updated 4 months ago
- Making code edting up to 7.7x faster using multi-layer speculation☆23Feb 20, 2025Updated last year
- An automatic prompt iteration and optimization generator suitable for any scenario☆16Jan 31, 2025Updated last year
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆972Jul 16, 2025Updated last year
- Heuristic filtering framework for RefineCode☆90Mar 13, 2025Updated last year
- This is the repository for the paper Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descripti…☆25Nov 18, 2022Updated 3 years ago
- Artifact for TOSEM Submission: GiantRepair☆12Jun 26, 2024Updated 2 years ago
- ☆58May 28, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 台大 計算機安全 (交大 程式安全) 2021 Fall☆26Feb 17, 2022Updated 4 years ago
- An Extensible Java Bug Benchmark for Automatic Program Repair Studies☆38Mar 4, 2024Updated 2 years ago
- “悟道”源代码☆21Aug 24, 2021Updated 5 years ago
- Code for ACL (main) paper "JumpCoder: Go Beyond Autoregressive Coder via Online Modification"☆25May 18, 2024Updated 2 years ago
- A Python library for parsing the Abstract Syntax Tree (AST) of compiled Solidity files.☆11Dec 1, 2023Updated 2 years ago
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆28Aug 27, 2025Updated last year
- NaturalCodeBench (Findings of ACL 2024)☆71Oct 14, 2024Updated 2 years ago