IBM / TDD-Bench-VerifiedLinks
TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)
☆25Updated 2 months ago
Alternatives and similar repositories for TDD-Bench-Verified
Users that are interested in TDD-Bench-Verified are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆61Updated 2 months ago
- EvoEval: Evolving Coding Benchmarks via LLM☆80Updated last year
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆83Updated last year
- ☆66Updated 11 months ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆64Updated last year
- Enhancing AI Software Engineering with Repository-level Code Graph☆225Updated 7 months ago
- Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"☆48Updated last week
- Training and Benchmarking LLMs for Code Preference.☆37Updated last year
- Dianshu-Liao / AAA-Code-Generation-Framework-for-Code-Repository-Local-Aware-Global-Aware-Third-Party-Aware☆24Updated last year
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆73Updated last year
- ☆53Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆179Updated last year
- We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of e…☆24Updated 3 years ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆157Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆162Updated 3 months ago
- ☆125Updated 2 years ago
- ☆15Updated 11 months ago
- Reinforcement Learning for Repository-Level Code Completion☆42Updated last year
- Baselines for all tasks from Long Code Arena benchmarks 🏟️☆36Updated 7 months ago
- Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions☆48Updated 2 months ago
- Benchmark ClassEval for class-level code generation.☆145Updated last year
- ☆45Updated 4 months ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆66Updated last year
- Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"☆117Updated last year
- Source codes for paper ”ReACC: A Retrieval-Augmented Code Completion Framework“☆63Updated 3 years ago
- Large Language Models Meet NL2Code: A Survey☆35Updated last year
- Source Code Data Augmentation for Deep Learning: A Survey.☆66Updated last year
- RepoQA: Evaluating Long-Context Code Understanding☆123Updated last year
- Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)☆95Updated 7 months ago
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆22Updated 2 months ago