The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
☆88Jul 13, 2024Updated 2 years ago
Alternatives and similar repositories for DebugBench
Users that are interested in DebugBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for the paper "COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis".☆18Feb 19, 2025Updated last year
- [TOSEM 2026]A Systematic Literature Review on Large Language Models for Automated Program Repair☆246May 1, 2026Updated 3 months ago
- Refactory: Re-factoring based Program Repair applied to Programming Assignments☆41Aug 16, 2022Updated 4 years ago
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆31Mar 5, 2024Updated 2 years ago
- Large Language Models(LLMs) of Code☆20Apr 23, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A multi-lingual program repair benchmark set based on the Quixey Challenge☆145Aug 29, 2022Updated 4 years ago
- Official implementation: Large Language Models are Interpretable Learners - Google☆13Jun 29, 2024Updated 2 years ago
- ☆15Jan 7, 2023Updated 3 years ago
- ☆10Apr 15, 2023Updated 3 years ago
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆88Jul 23, 2026Updated last month
- An implementation of Tare.☆12Feb 23, 2024Updated 2 years ago
- Efficient APR with LLMs http://arxiv.org/pdf/2402.06598☆16May 28, 2024Updated 2 years ago
- BugsInPy: Benchmarking Bugs in Python Projects☆151Feb 10, 2026Updated 6 months ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆212Aug 16, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆24Aug 17, 2024Updated 2 years ago
- A Reproducible Benchmark of Recent Java Bugs☆52Aug 19, 2025Updated last year
- Official repository for our paper "FullStack Bench: Evaluating LLMs as Full Stack Coders"☆121May 7, 2025Updated last year
- ☆13Oct 18, 2023Updated 2 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- Repo for the paper: Towards Few-shot Entity Recognition in Document Images:A Label-aware Sequence-to-Sequence Framework☆14May 31, 2023Updated 3 years ago
- [ICSE'25] Aligning the Objective of LLM-based Program Repair☆24Mar 8, 2025Updated last year
- Making code edting up to 7.7x faster using multi-layer speculation☆23Feb 20, 2025Updated last year
- The guide of paper writing in Latex☆21Mar 18, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆18Mar 28, 2026Updated 5 months ago
- ☆58May 28, 2024Updated 2 years ago
- 台大 計算機安全 (交大 程式安全) 2021 Fall☆25Feb 17, 2022Updated 4 years ago
- ☆142Jun 6, 2025Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆90Sep 17, 2024Updated last year
- “悟道”源代码☆21Aug 24, 2021Updated 5 years ago
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆28Aug 27, 2025Updated last year
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆935Jul 16, 2025Updated last year
- Code for ACL (main) paper "JumpCoder: Go Beyond Autoregressive Coder via Online Modification"☆25May 18, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- NaturalCodeBench (Findings of ACL 2024)☆70Oct 14, 2024Updated last year
- EvoEval: Evolving Coding Benchmarks via LLM☆84Apr 6, 2024Updated 2 years ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆74May 13, 2025Updated last year
- ☆11Nov 2, 2022Updated 3 years ago
- Repo for paper "Tell Me More! Towards Implicit User Intention Understanding of Language Model Driven Agents"☆66Feb 20, 2024Updated 2 years ago
- Repo of "Large Language Model-based Human-Agent Collaboration for Complex Task Solving(EMNLP2024 Findings)"☆34Sep 20, 2024Updated last year
- This is the repository for the paper titled "ThinkRepair: Self-Directed Automated Program Repair" accepted by ISSTA'24.☆31Jan 10, 2026Updated 7 months ago