The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
☆86Jul 13, 2024Updated last year
Alternatives and similar repositories for DebugBench
Users that are interested in DebugBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆31Mar 5, 2024Updated 2 years ago
- [TOSEM 2026]A Systematic Literature Review on Large Language Models for Automated Program Repair☆242May 1, 2026Updated last month
- A multi-lingual program repair benchmark set based on the Quixey Challenge☆141Aug 29, 2022Updated 3 years ago
- This repo is for our submission for ICSE 2025.☆20Jun 12, 2024Updated last year
- Official implementation: Large Language Models are Interpretable Learners - Google☆13Jun 29, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICSE'25] Aligning the Objective of LLM-based Program Repair☆24Mar 8, 2025Updated last year
- ☆10Apr 15, 2023Updated 3 years ago
- An implementation of Tare.☆12Feb 23, 2024Updated 2 years ago
- LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step (ACL'24)☆587Sep 10, 2024Updated last year
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆83Apr 28, 2026Updated last month
- Efficient APR with LLMs http://arxiv.org/pdf/2402.06598☆16May 28, 2024Updated 2 years ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆208Aug 16, 2024Updated last year
- ☆12May 30, 2025Updated last year
- ☆24Aug 17, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench/tree/main/scenarios☆15Feb 24, 2026Updated 3 months ago
- A Reproducible Benchmark of Recent Java Bugs☆50Aug 19, 2025Updated 9 months ago
- ☆13Oct 18, 2023Updated 2 years ago
- ☆44Mar 6, 2026Updated 3 months ago
- Official repository for our paper "FullStack Bench: Evaluating LLMs as Full Stack Coders"☆121May 7, 2025Updated last year
- ☆138Jun 6, 2025Updated last year
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- Repo for the paper: Towards Few-shot Entity Recognition in Document Images:A Label-aware Sequence-to-Sequence Framework☆14May 31, 2023Updated 3 years ago
- Source Code for "Exploring and Unleashing the Power of Large Language Models in Automated Code Translation"☆28Jul 15, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆47May 6, 2025Updated last year
- 台大 計算機安全 (交大 程式安全) 2021 Fall☆24Feb 17, 2022Updated 4 years ago
- An automatic prompt iteration and optimization generator suitable for any scenario☆16Jan 31, 2025Updated last year
- ☆28Jun 2, 2026Updated last week
- ☆57May 28, 2024Updated 2 years ago
- ☆27Updated this week
- The guide of paper writing in Latex☆21Mar 18, 2026Updated 2 months ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆89Sep 17, 2024Updated last year
- This is the repository for the paper Static Prediction of Runtime Errors by Learning to Execute Programs with External Resource Descripti…☆25Nov 18, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Artifact for TOSEM Submission: GiantRepair☆12Jun 26, 2024Updated last year
- Code for ACL (main) paper "JumpCoder: Go Beyond Autoregressive Coder via Online Modification"☆25May 18, 2024Updated 2 years ago
- Automate the build, execution and test of GitHub repositories across programming languages and operating systems.☆104Updated this week
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆882Jul 16, 2025Updated 10 months ago
- ☆13Mar 5, 2025Updated last year
- EvoEval: Evolving Coding Benchmarks via LLM☆84Apr 6, 2024Updated 2 years ago
- This is the repository for the paper titled "ThinkRepair: Self-Directed Automated Program Repair" accepted by ISSTA'24.☆31Jan 10, 2026Updated 5 months ago