An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
☆67Aug 15, 2024Updated last year
Alternatives and similar repositories for EvoCodeBench
Users that are interested in EvoCodeBench are comparing it to the libraries listed below
Sorting:
- Code Snippet Recommendation from Stack Overflow Post☆19Jun 30, 2021Updated 4 years ago
- Benchmark ClassEval for class-level code generation.☆145Oct 24, 2024Updated last year
- A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories☆36Sep 4, 2024Updated last year
- ☆22Nov 19, 2024Updated last year
- ☆24Dec 16, 2023Updated 2 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated last year
- ☆12Aug 9, 2023Updated 2 years ago
- ☆14Jun 3, 2025Updated 8 months ago
- A Prompt Learning Framework for Source Code Summarization☆14Dec 26, 2023Updated 2 years ago
- [ACL25] FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation☆44Jan 28, 2026Updated last month
- [ISSTA 2025] A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing☆13Feb 9, 2025Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆174Aug 15, 2025Updated 6 months ago
- A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.☆154Dec 25, 2024Updated last year
- repo for the paper titled “CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation”☆14Oct 4, 2023Updated 2 years ago
- Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)☆34Mar 24, 2025Updated 11 months ago
- the implementation of Embedding API Dependency Graph for Neural Code Generation☆12Jun 6, 2021Updated 4 years ago
- ☆14Jun 19, 2023Updated 2 years ago
- CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context☆18Feb 20, 2026Updated last week
- code for "Implant Global and Local Hierarchy Information to Sequence based Code Representation Models"☆12Dec 13, 2024Updated last year
- ☆14Mar 23, 2023Updated 2 years ago
- ☆19Aug 23, 2024Updated last year
- ☆58Jun 19, 2024Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆189Aug 16, 2024Updated last year
- "Why do I feel offended?" - Korean Dataset for Offensive Language Identification (EACL2023 Findings)☆15May 14, 2023Updated 2 years ago
- An automatic prompt iteration and optimization generator suitable for any scenario☆16Jan 31, 2025Updated last year
- Reinforcement Learning for Repository-Level Code Completion☆42Aug 19, 2024Updated last year
- A pytorch implementation of Abstract Syntax Networks☆13Jun 27, 2025Updated 8 months ago
- NaturalCodeBench (Findings of ACL 2024)☆68Oct 14, 2024Updated last year
- CodeRAG-Bench: Can Retrieval Augment Code Generation?☆168Nov 15, 2024Updated last year
- The official PyTorch implementation for SIGIR 2024 paper "SIGformer: sign-aware graph transformer for recommendation".☆20Sep 4, 2024Updated last year
- EvoEval: Evolving Coding Benchmarks via LLM☆81Apr 6, 2024Updated last year
- A Comprehensive Benchmark for Software Development.☆127May 30, 2024Updated last year
- Code for NeurIPS 2024 paper "AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning"☆51Nov 10, 2024Updated last year
- Replication package for ISSTA2023 paper - Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond☆23Apr 9, 2023Updated 2 years ago
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆23Mar 18, 2025Updated 11 months ago
- TheWebConf'24 full paper - "Linear-Time Graph Neural Networks for Scalable Recommendations"☆21Jul 23, 2025Updated 7 months ago
- ☆20Mar 6, 2023Updated 2 years ago
- [ICLR 2025] The implementation of paper "Preference Diffusion for Recommendation"☆23Apr 21, 2025Updated 10 months ago
- [EMNLP 2023] Official Code of "JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Class…☆23May 13, 2024Updated last year