facebookresearch / testgenevalLinks
TestGenEval A Real World Unit Test Generation and Test Completion Benchmark
☆26Updated last week
Alternatives and similar repositories for testgeneval
Users that are interested in testgeneval are comparing it to the libraries listed below
Sorting:
- ☆33Updated 11 months ago
- Benchmark ClassEval for class-level code generation.☆145Updated last year
- TeCo: an ML+Execution model for test completion☆32Updated last year
- ☆164Updated 5 months ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆67Updated last year
- Pip compatible CodeBLEU metric implementation available for linux/macos/win☆128Updated 9 months ago
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆67Updated last month
- This is the repository for the paper titled "ThinkRepair: Self-Directed Automated Program Repair" accepted by ISSTA'24.☆27Updated last week
- Large Language Models for Software Engineering☆259Updated 5 months ago
- A multi-lingual program repair benchmark set based on the Quixey Challenge☆132Updated 3 years ago
- Reinforcement Learning for Repository-Level Code Completion☆42Updated last year
- [NeurIPS'24] SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning☆26Updated last year
- RepairAgent is an autonomous LLM-based agent for software repair.☆81Updated 5 months ago
- methods2test is a supervised dataset consisting of Test Cases and their corresponding Focal Methods from a set of Java software repositor…☆172Updated 2 years ago
- RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program Repair http://arxiv.org/pdf/2312.15698☆39Updated 4 months ago
- [TOSEM 2023] A Survey of Learning-based Automated Program Repair☆74Updated last year
- This is the tool released in the ASE'23 paper "Generative Type Inference for Python".☆28Updated 2 years ago
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆24Updated 4 months ago
- Source Code Data Augmentation for Deep Learning: A Survey.☆66Updated last year
- ☆57Updated last year
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆51Updated 9 months ago
- ☆26Updated 3 years ago
- ✅SRepair: Powerful LLM-based Program Repairer with $0.029/Fixed Bug☆73Updated last year
- Repo-Level Code generation papers☆230Updated last month
- ☆153Updated 7 months ago
- BugsInPy: Benchmarking Bugs in Python Projects☆122Updated this week
- A Reproducible Benchmark of Recent Java Bugs☆44Updated 5 months ago
- ☆24Updated last year
- LLM agent to automatically set up arbitrary projects and run their test suites☆57Updated 6 months ago
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆85Updated last year