An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
☆72Aug 15, 2024Updated 2 years ago
Alternatives and similar repositories for EvoCodeBench
Users that are interested in EvoCodeBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Nov 19, 2024Updated last year
- A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories☆43Sep 4, 2024Updated 2 years ago
- Benchmark ClassEval for class-level code generation.☆154Oct 24, 2024Updated 2 years ago
- ☆20Mar 6, 2023Updated 3 years ago
- ☆67Jun 19, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆184Aug 15, 2025Updated last year
- Replication package of the paper "Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models" (T…☆23Oct 14, 2024Updated 2 years ago
- Official implementation of our ICSE 2023 paper on Automatic Code Generation.☆27Nov 8, 2023Updated 2 years ago
- A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.☆160Dec 25, 2024Updated last year
- SolEval is the 1st evaluation framework designed to benchmark Large Language Models (LLMs) for generating Solidity smart contracts at the…☆14Feb 10, 2026Updated 8 months ago
- ☆26Dec 16, 2023Updated 2 years ago
- CodeRAG-Bench: Can Retrieval Augment Code Generation?☆173Nov 15, 2024Updated last year
- Code and data for the ICSE 2025 paper "HumanEvo: An Evolving-aware Benchmark for More Realistic Evaluation of Repository-level Code Gener…☆13Feb 10, 2025Updated last year
- ☆17Apr 7, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆30Apr 2, 2023Updated 3 years ago
- code for "Implant Global and Local Hierarchy Information to Sequence based Code Representation Models"☆12Dec 13, 2024Updated last year
- Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)☆34Mar 24, 2025Updated last year
- Code for ICSE'24 Paper☆14Apr 21, 2024Updated 2 years ago
- CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context☆19Feb 20, 2026Updated 8 months ago
- 1st OpenSource Digital Employee Breeding Factory☆16May 1, 2026Updated 5 months ago
- This is the tool released in the ASE'23 paper "Generative Type Inference for Python".☆28Sep 12, 2023Updated 3 years ago
- ☆13Aug 9, 2023Updated 3 years ago
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆24Mar 18, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆14Jun 3, 2025Updated last year
- ☆12May 30, 2025Updated last year
- EvoEval: Evolving Coding Benchmarks via LLM☆84Apr 6, 2024Updated 2 years ago
- Must-read papers on Repository-level Code Generation & Issue Resolution 🔥☆336Oct 21, 2026Updated last week
- ☆16Aug 26, 2023Updated 3 years ago
- [ISSTA'24] A Large-Scale Dataset Capable of Enhancing the Prowess of Large Language Models for Program Testing☆12Jan 7, 2025Updated last year
- ☆15Nov 9, 2024Updated last year
- This is the tool released in ICSE 2024 paper "Domain Knowledge Matters: Improving Prompts with Fix Templates for Repairing Python Type Er…☆17Jun 5, 2023Updated 3 years ago
- [EMNLP 2023] Official Code of "JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Class…☆24May 13, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆37May 29, 2025Updated last year
- A multi-programming language benchmark for LLMs☆317Apr 12, 2026Updated 6 months ago
- ☆240Feb 28, 2026Updated 8 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆174Oct 11, 2024Updated 2 years ago
- repo for the paper titled “CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation”☆15Oct 4, 2023Updated 3 years ago
- Code and plugin for paper "Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow“☆16Nov 19, 2022Updated 3 years ago
- "Why do I feel offended?" - Korean Dataset for Offensive Language Identification (EACL2023 Findings)☆16May 14, 2023Updated 3 years ago