facebookresearch / testgenevalLinks
TestGenEval A Real World Unit Test Generation and Test Completion Benchmark
☆24Updated 11 months ago
Alternatives and similar repositories for testgeneval
Users that are interested in testgeneval are comparing it to the libraries listed below
Sorting:
- ☆31Updated 9 months ago
- Benchmark ClassEval for class-level code generation.☆145Updated last year
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆22Updated 2 months ago
- [NeurIPS'24] SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning☆26Updated last year
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆66Updated last year
- ☆161Updated 3 months ago
- A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories☆35Updated last year
- Pip compatible CodeBLEU metric implementation available for linux/macos/win☆122Updated 7 months ago
- Reinforcement Learning for Repository-Level Code Completion☆42Updated last year
- ☆33Updated 2 years ago
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆50Updated 7 months ago
- ☆15Updated 11 months ago
- Source Code Data Augmentation for Deep Learning: A Survey.☆66Updated last year
- This repo illustrates how to evaluate the artifacts in the paper An Extensive Study on Pre-trained Models for Program Understanding and G…☆25Updated 3 years ago
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆84Updated last year
- methods2test is a supervised dataset consisting of Test Cases and their corresponding Focal Methods from a set of Java software repositor…☆171Updated last year
- This is the tool released in the ASE'23 paper "Generative Type Inference for Python".☆28Updated 2 years ago
- EvoEval: Evolving Coding Benchmarks via LLM☆80Updated last year
- TeCo: an ML+Execution model for test completion☆31Updated last year
- Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"☆53Updated last year
- Repo-Level Code generation papers☆221Updated 4 months ago
- For our ICSE23 paper "Impact of Code Language Models on Automated Program Repair" by Nan Jiang, Kevin Liu, Thibaud Lutellier, and Lin Tan☆62Updated last year
- Enhacing Code Pre-trained Models by Contrastive Learning☆36Updated 2 years ago
- Code for ACL (main) paper "JumpCoder: Go Beyond Autoregressive Coder via Online Modification"☆27Updated last year
- ☆125Updated 2 years ago
- ☆53Updated last year
- LLM agent to automatically set up arbitrary projects and run their test suites☆48Updated 4 months ago
- ☆48Updated last year
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆61Updated 2 months ago
- Large Language Models for Software Engineering☆255Updated 3 months ago