Simultaneous evaluation on both functionality and security of LLM-generated code.
☆49Jul 30, 2026Updated 3 months ago
Alternatives and similar repositories for CWEval
Users that are interested in CWEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Dec 22, 2025Updated 10 months ago
- ☆55Jul 16, 2024Updated 2 years ago
- ☆18Sep 24, 2025Updated last year
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆98Nov 4, 2023Updated 2 years ago
- CodeGuard+: Constrained Decoding for Secure Code Generation☆22Jul 30, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official repo for "ProSec: Fortifying Code LLMs with Proactive Security Alignment"☆19Feb 26, 2026Updated 8 months ago
- 🔮Reasoning for Safer Code Generation; 🥇Winner Solution of Amazon Nova AI Challenge 2025☆41Aug 24, 2025Updated last year
- ☆108Jan 30, 2026Updated 9 months ago
- Implementation and datasets for "Training Language Models to Generate Quality Code with Program Analysis Feedback"☆43Jul 21, 2025Updated last year
- SecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).☆135Oct 12, 2026Updated 3 weeks ago
- NL prompts generating code with LLMs covering security-relevant scenarios☆62Oct 4, 2024Updated 2 years ago
- ☆133Jul 14, 2024Updated 2 years ago
- Repo for arxiv paper "A Systematic Study of Code Obfuscation Against LLM-based Vulnerability Detection".☆15Dec 18, 2025Updated 10 months ago
- ☆13Oct 11, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ICSE'24 Industry Challenge Track] "ReposVul: A Repository-Level High-Quality Vulnerability Dataset".☆114Nov 24, 2024Updated last year
- ☆30Sep 15, 2024Updated 2 years ago
- This repository offers a detailed taxonomy of existing AI-driven security solutions tailored for DevSecOps, highlighting the current rese…☆20Jul 2, 2025Updated last year
- [ICML 2026] Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks☆57Oct 22, 2026Updated last week
- Ask to Know More: Counterfactual Explanations for Fake Claims source code☆11Nov 22, 2022Updated 3 years ago
- Repository for PrimeVul Vulnerability Detection Dataset☆282Sep 7, 2024Updated 2 years ago
- The NEKO Project is an open source effort to build a model of equivalent scale and capability as that reported in DeepMind’s 2022 Paper, …☆10Sep 2, 2023Updated 3 years ago
- Real-World Security Conversations for AI Training☆11Jul 6, 2026Updated 3 months ago
- Source Code Data Augmentation for Deep Learning: A Survey.☆66Jun 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Automated Benchmarking of LLM Agents on Real-World Software Security Tasks [NeurIPS 2025]☆104Jan 27, 2026Updated 9 months ago
- MoreFixes: A Large-Scale Dataset of CVE Fix Commits Mined through Enhanced Repository Discovery☆88Sep 25, 2026Updated last month
- A DL compiler fuzzer☆15Nov 1, 2024Updated 2 years ago
- ☆11Oct 18, 2022Updated 4 years ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆68May 4, 2025Updated last year
- [ICLR 2026] Official implementation for "RedCodeAgent: Automatic Red-teaming Agent against Diverse Code Agents"☆14Apr 24, 2026Updated 6 months ago
- ☆17Oct 14, 2026Updated 2 weeks ago
- ☆15Apr 28, 2022Updated 4 years ago
- Official implementation of **LLMs Caught in the Crossfire: Malware Requests and Jailbreak Challenges (ACL 2025)**☆13May 25, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [2023 TDSC] Pre-trained Model-based Automated Software Vulnerability Repair: How Far are We?☆24Jun 2, 2023Updated 3 years ago
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆78Oct 29, 2025Updated last year
- A browser fuzzer augmented by API mod-ref relations☆35Mar 8, 2024Updated 2 years ago
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆194Oct 23, 2024Updated 2 years ago
- The replication package of paper "Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks"☆28Jan 3, 2024Updated 2 years ago
- [NeurIPS 2026 🏆 Oral] AgentAbstain: Systematic Evaluation Framework of Agentic Abstention☆22Sep 28, 2026Updated last month
- ☆15Jul 30, 2024Updated 2 years ago