The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
☆85Jul 13, 2024Updated last year
Alternatives and similar repositories for DebugBench
Users that are interested in DebugBench are comparing it to the libraries listed below
Sorting:
- Official repository for the paper "COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis".☆18Feb 19, 2025Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆30Mar 5, 2024Updated 2 years ago
- [TOSEM 2026]A Systematic Literature Review on Large Language Models for Automated Program Repair☆232Mar 13, 2026Updated last week
- Refactory: Re-factoring based Program Repair applied to Programming Assignments☆40Aug 16, 2022Updated 3 years ago
- Large Language Models(LLMs) of Code☆20Apr 23, 2023Updated 2 years ago
- This repo is for our submission for ICSE 2025.☆20Jun 12, 2024Updated last year
- A multi-lingual program repair benchmark set based on the Quixey Challenge☆137Aug 29, 2022Updated 3 years ago
- Official implementation: Large Language Models are Interpretable Learners - Google☆13Jun 29, 2024Updated last year
- Code for EMNLP 2021 Paper "Recall and Learn: A Memory-augmented Solver for Math Word Problems".☆16Oct 20, 2022Updated 3 years ago
- ☆15Jan 7, 2023Updated 3 years ago
- [ICSE'25] Aligning the Objective of LLM-based Program Repair☆23Mar 8, 2025Updated last year
- ☆10Apr 15, 2023Updated 2 years ago
- LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step (ACL'24)☆581Sep 10, 2024Updated last year
- Efficient APR with LLMs http://arxiv.org/pdf/2402.06598☆16May 28, 2024Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆192Aug 16, 2024Updated last year
- ☆23Aug 17, 2024Updated last year
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench/tree/main/scenarios☆15Feb 24, 2026Updated 3 weeks ago
- ✅SRepair: Powerful LLM-based Program Repairer with $0.029/Fixed Bug☆74Apr 22, 2024Updated last year
- A Reproducible Benchmark of Recent Java Bugs☆47Aug 19, 2025Updated 7 months ago
- Official repository for our paper "FullStack Bench: Evaluating LLMs as Full Stack Coders"☆115May 7, 2025Updated 10 months ago
- Repo for the paper: Towards Few-shot Entity Recognition in Document Images:A Label-aware Sequence-to-Sequence Framework☆14May 31, 2023Updated 2 years ago
- Making code edting up to 7.7x faster using multi-layer speculation☆24Feb 20, 2025Updated last year
- Source Code for "Exploring and Unleashing the Power of Large Language Models in Automated Code Translation"☆27Jul 15, 2025Updated 8 months ago
- ☆44May 6, 2025Updated 10 months ago
- 台大 計算機安全 (交大 程式安全) 2021 Fall☆24Feb 17, 2022Updated 4 years ago
- ☆56May 28, 2024Updated last year
- ☆28Nov 10, 2025Updated 4 months ago
- ☆23Feb 23, 2026Updated 3 weeks ago
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆26Aug 27, 2025Updated 6 months ago
- The guide of paper writing in Latex☆19Feb 7, 2025Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆87Sep 17, 2024Updated last year
- This is the repository for the paper Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descripti…☆25Nov 18, 2022Updated 3 years ago
- Artifact for TOSEM Submission: GiantRepair☆13Jun 26, 2024Updated last year
- Code for ACL (main) paper "JumpCoder: Go Beyond Autoregressive Coder via Online Modification"☆27May 18, 2024Updated last year
- ☆30Jul 17, 2024Updated last year
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆817Jul 16, 2025Updated 8 months ago
- NaturalCodeBench (Findings of ACL 2024)☆68Oct 14, 2024Updated last year
- ☆13Mar 5, 2025Updated last year
- EvoEval: Evolving Coding Benchmarks via LLM☆81Apr 6, 2024Updated last year