SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and reasoning capabilities) of LLMs for vulnerability detection.
☆64May 4, 2025Updated 10 months ago
Alternatives and similar repositories for SecLLMHolmes
Users that are interested in SecLLMHolmes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for PrimeVul Vulnerability Detection Dataset☆228Sep 7, 2024Updated last year
- ☆39Jun 23, 2025Updated 9 months ago
- [ICSE'24 Industry Challenge Track] "ReposVul: A Repository-Level High-Quality Vulnerability Dataset".☆93Nov 24, 2024Updated last year
- SeqTrans: Automatic Vulnerability Fix via Sequence to Sequence Learning☆17Mar 9, 2022Updated 4 years ago
- Source code for LLMxCPG paper☆127Feb 10, 2026Updated last month
- SecVulEval is a dataset of C/C++ vulnerabilities.☆18Dec 20, 2025Updated 3 months ago
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆40Mar 20, 2025Updated last year
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆75Oct 29, 2025Updated 4 months ago
- ☆225Jul 25, 2024Updated last year
- A continuously updated collection of CodeLLM papers maintained by PurCL group @ Purdue☆612Jan 14, 2026Updated 2 months ago
- ☆16Nov 24, 2023Updated 2 years ago
- The replication package of paper "Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks"☆28Jan 3, 2024Updated 2 years ago
- (NDSS 2024) Optimizing Decompiler Output with LLM☆129Sep 8, 2024Updated last year
- Hey folks, this is a repository for papers on LLM for Vuln. Detection area☆77Apr 2, 2025Updated 11 months ago
- A Transformer-based Line-Level Vulnerability Prediction☆161Aug 5, 2024Updated last year
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆139Jan 12, 2025Updated last year
- ☆21Aug 25, 2024Updated last year
- Code audit (code review) with VIM.☆17Jan 3, 2025Updated last year
- Multi-granularity vulnerability detection with a novel pre-trained code model☆19Dec 15, 2025Updated 3 months ago
- Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks☆256Jan 19, 2024Updated 2 years ago
- A C/C++ Code Vulnerability Dataset with Code Changes and CVE Summaries☆357Mar 25, 2021Updated 4 years ago
- Python library for CPGQL server☆41Jun 4, 2024Updated last year
- A manually vetted dataset for security vulnerability detection in Java projects☆92Aug 12, 2025Updated 7 months ago
- Awesome Large Language Models for Vulnerability Detection☆398Updated this week
- Source code of AsiaCCS'22 paper - RecIPE: Revisiting the Evaluation of Memory Error Defenses☆13Sep 19, 2023Updated 2 years ago
- ☆58May 10, 2024Updated last year
- Code Aware Services (CAS) is a set of tools for extracting information from a (especially large) source code trees. It consists of Build …☆62Aug 1, 2025Updated 7 months ago
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆176Oct 23, 2024Updated last year
- KFLAT is a tool to serialize memory of selected variables from the running Linux kernel and organize it into a single memory block of con…☆30Jan 20, 2026Updated 2 months ago
- The datasets and source code of the NDSS 2025 paper《BinEnhance: An Enhancement Framework Based on External Environment Semantics for Bina…☆30Nov 13, 2025Updated 4 months ago
- The source code of project "LLift" (Enhancing static analysis with LLM)☆86Mar 5, 2024Updated 2 years ago
- ☆50Jan 19, 2019Updated 7 years ago
- Framework for testing the reachability of native functions in Android applications.☆11Aug 30, 2023Updated 2 years ago
- ☆51Jul 16, 2024Updated last year
- GPTCloneBench is a clone detection benchmark based on SemanticCloneBench and GPT.☆16Feb 5, 2025Updated last year
- An standalone execution trace library built on DynamoRIO.☆23Jul 4, 2022Updated 3 years ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆179Feb 23, 2026Updated last month
- An overview of LLMs for cybersecurity.☆1,259Mar 13, 2026Updated last week
- Source Code for Paper "Large Language Models are Few-Shot Summarizers: Multi-Intent Comment Generation via In-Context Learning"☆18Jun 9, 2023Updated 2 years ago