A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories
☆41Sep 4, 2024Updated last year
Alternatives and similar repositories for DevEval
Users that are interested in DevEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆64Jun 19, 2024Updated 2 years ago
- ☆29Jul 20, 2024Updated 2 years ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆71Aug 15, 2024Updated last year
- [NAACL 2025] Benchmark for Repository-Level Code Generation, focus on Executability, Correctness from Test Cases and Usage of Contexts fr…☆45Jan 8, 2026Updated 6 months ago
- A web application built with Flask and meant to simulate a real-world result management system☆11Jan 6, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆20Oct 30, 2024Updated last year
- ☆14Jul 22, 2021Updated 5 years ago
- "Why do I feel offended?" - Korean Dataset for Offensive Language Identification (EACL2023 Findings)☆15May 14, 2023Updated 3 years ago
- ☆27Sep 23, 2024Updated last year
- ☆14May 28, 2024Updated 2 years ago
- A recommender system that recommends cryptocurrencies to investors.☆10Mar 26, 2021Updated 5 years ago
- Large Language Models for Software Engineering: A Systematic Literature Review☆107Dec 8, 2025Updated 7 months ago
- ☆25Oct 2, 2024Updated last year
- ☆33Jan 14, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Comprehensive Benchmark for Software Development.☆137May 30, 2024Updated 2 years ago
- The Infibench variant of bigcode-evaluation-harness --- a framework for the evaluation of autoregressive code generation language models.☆14Oct 19, 2024Updated last year
- ☆141Jun 6, 2025Updated last year
- ☆10Aug 25, 2021Updated 4 years ago
- ☆15Dec 12, 2023Updated 2 years ago
- [EMNLP 2023] CodeTransOcean: A Comprehensive Multilingual Benchmark for Code Translation☆59Nov 16, 2023Updated 2 years ago
- A Code Efficiency Benchmark for Code Generation☆14May 26, 2025Updated last year
- Official repository of the paper: Marking Code Without Breaking It: Code Watermarking for Detecting LLM-Generated Code (Findings of EACL …☆12Mar 26, 2026Updated 3 months ago
- The official codes for our paper at COLING 2022: Semantic-Preserving Adversarial Code Comprehension☆12Oct 23, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Artifact for TOSEM Submission: GiantRepair☆12Jun 26, 2024Updated 2 years ago
- ☆29Jul 3, 2026Updated 3 weeks ago
- 💎 Core smart contracts of the lending protocol on TON☆13Mar 1, 2023Updated 3 years ago
- Code and data for the paper: On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agents☆49Dec 15, 2025Updated 7 months ago
- ☆15Feb 8, 2025Updated last year
- ☆15May 7, 2025Updated last year
- [ICSE 2024] Code Search is All You Need? Improving Code Suggestions With Code Search☆13Apr 24, 2024Updated 2 years ago
- This repository is for the paper of ICSE 2023: Regression Fuzzing for Deep Learning Systems☆11Feb 21, 2024Updated 2 years ago
- ☆87Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"☆49Jun 2, 2026Updated last month
- One-stop yield farming platform on TON blockchain☆18May 21, 2024Updated 2 years ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆274Mar 29, 2026Updated 3 months ago
- Shell On MOS [MIPS(R3000) Operating System]☆43Mar 19, 2022Updated 4 years ago
- ☆10Jul 14, 2024Updated 2 years ago
- Code and data for AAAI 2022 paper "Multilingual Code Snippets Training for Program Translation"☆11Mar 7, 2022Updated 4 years ago
- Baselines for all tasks from Long Code Arena benchmarks 🏟️☆38Mar 30, 2025Updated last year