facebookresearch / testgenevalLinks
TestGenEval A Real World Unit Test Generation and Test Completion Benchmark
☆26Updated 2 weeks ago
Alternatives and similar repositories for testgeneval
Users that are interested in testgeneval are comparing it to the libraries listed below
Sorting:
- ☆32Updated 11 months ago
- Benchmark ClassEval for class-level code generation.☆146Updated last year
- A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories☆35Updated last year
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆67Updated last year
- TeCo: an ML+Execution model for test completion☆32Updated last year
- Reinforcement Learning for Repository-Level Code Completion☆43Updated last year
- Source Code Data Augmentation for Deep Learning: A Survey.☆66Updated last year
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆23Updated 4 months ago
- Large Language Models for Software Engineering☆257Updated 5 months ago
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆51Updated 8 months ago
- Baselines for all tasks from Long Code Arena benchmarks 🏟️☆38Updated 9 months ago
- ☆162Updated 5 months ago
- [NeurIPS'24] SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning☆26Updated last year
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆64Updated last week
- Pip compatible CodeBLEU metric implementation available for linux/macos/win☆127Updated 8 months ago
- This is the tool released in the ASE'23 paper "Generative Type Inference for Python".☆28Updated 2 years ago
- EvoEval: Evolving Coding Benchmarks via LLM☆80Updated last year
- Automated Benchmarking of LLM Agents on Real-World Software Security Tasks [NeurIPS 2025]☆46Updated last month
- ✅SRepair: Powerful LLM-based Program Repairer with $0.029/Fixed Bug☆71Updated last year
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆85Updated last year
- ☆24Updated last year
- Repo-Level Code generation papers☆226Updated 2 weeks ago
- RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program Repair http://arxiv.org/pdf/2312.15698☆39Updated 3 months ago
- BugsInPy: Benchmarking Bugs in Python Projects☆121Updated 2 weeks ago
- For our ICSE23 paper "Impact of Code Language Models on Automated Program Repair" by Nan Jiang, Kevin Liu, Thibaud Lutellier, and Lin Tan☆62Updated last year
- RepairAgent is an autonomous LLM-based agent for software repair.☆79Updated 5 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆166Updated 4 months ago
- Enhacing Code Pre-trained Models by Contrastive Learning☆37Updated 2 years ago
- methods2test is a supervised dataset consisting of Test Cases and their corresponding Focal Methods from a set of Java software repositor…☆172Updated 2 years ago
- LLM agent to automatically set up arbitrary projects and run their test suites☆53Updated 5 months ago