LLM4SoftwareTesting / TestEvalLinks
☆31Updated 9 months ago
Alternatives and similar repositories for TestEval
Users that are interested in TestEval are comparing it to the libraries listed below
Sorting:
- TestGenEval A Real World Unit Test Generation and Test Completion Benchmark☆24Updated 10 months ago
- Large Language Models for Software Engineering☆250Updated 3 months ago
- Benchmark ClassEval for class-level code generation.☆145Updated last year
- LLM agent to automatically set up arbitrary projects and run their test suites☆46Updated 3 months ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆63Updated last year
- ✅SRepair: Powerful LLM-based Program Repairer with $0.029/Fixed Bug☆70Updated last year
- ☆52Updated last year
- TeCo: an ML+Execution model for test completion☆31Updated last year
- ☆159Updated 3 months ago
- Repo-Level Code generation papers☆215Updated 3 months ago
- A Systematic Literature Review on Large Language Models for Automated Program Repair☆210Updated this week
- RepairAgent is an autonomous LLM-based agent for software repair.☆71Updated 3 months ago
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆83Updated last year
- This repo is for our submission for ICSE 2025.☆20Updated last year
- [TOSEM 2023] A Survey of Learning-based Automated Program Repair☆72Updated last year
- [ISSTA 2025] A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing☆13Updated 8 months ago
- Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)☆28Updated 7 months ago
- Reinforcement Learning for Repository-Level Code Completion☆40Updated last year
- A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.☆152Updated 10 months ago
- methods2test is a supervised dataset consisting of Test Cases and their corresponding Focal Methods from a set of Java software repositor…☆168Updated last year
- Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)☆94Updated 7 months ago
- We introduce FixEval , a dataset for competitive programming bug fixing along with a comprehensive test suite and show the necessity of e…☆24Updated 3 years ago
- EvoEval: Evolving Coding Benchmarks via LLM☆76Updated last year
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆50Updated 6 months ago
- Pip compatible CodeBLEU metric implementation available for linux/macos/win☆117Updated 6 months ago
- A multi-lingual program repair benchmark set based on the Quixey Challenge☆129Updated 3 years ago
- ☆38Updated 4 months ago
- Dianshu-Liao / AAA-Code-Generation-Framework-for-Code-Repository-Local-Aware-Global-Aware-Third-Party-Aware☆21Updated last year
- Repository for the paper "Large Language Model-Based Agents for Software Engineering: A Survey". Keep updating.☆506Updated 7 months ago
- [2023 ASE] GAMMA: Revisiting Template-based Automated Program Repair via Mask Prediction☆22Updated 2 years ago