SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and reasoning capabilities) of LLMs for vulnerability detection.
☆64May 4, 2025Updated 11 months ago
Alternatives and similar repositories for SecLLMHolmes
Users that are interested in SecLLMHolmes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for PrimeVul Vulnerability Detection Dataset☆234Sep 7, 2024Updated last year
- ☆38Jun 23, 2025Updated 9 months ago
- [ICSE'24 Industry Challenge Track] "ReposVul: A Repository-Level High-Quality Vulnerability Dataset".☆99Nov 24, 2024Updated last year
- SeqTrans: Automatic Vulnerability Fix via Sequence to Sequence Learning☆17Mar 9, 2022Updated 4 years ago
- Source code for LLMxCPG paper☆128Mar 26, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- SecVulEval is a dataset of C/C++ vulnerabilities.☆19Mar 29, 2026Updated 2 weeks ago
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆76Oct 29, 2025Updated 5 months ago
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆41Mar 20, 2025Updated last year
- ☆227Jul 25, 2024Updated last year
- A continuously updated collection of CodeLLM papers maintained by PurCL group @ Purdue☆617Jan 14, 2026Updated 2 months ago
- ☆16Nov 24, 2023Updated 2 years ago
- The replication package of paper "Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks"☆28Jan 3, 2024Updated 2 years ago
- (NDSS 2024) Optimizing Decompiler Output with LLM☆130Sep 8, 2024Updated last year
- Hey folks, this is a repository for papers on LLM for Vuln. Detection area☆79Apr 2, 2025Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Transformer-based Line-Level Vulnerability Prediction☆164Aug 5, 2024Updated last year
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆144Jan 12, 2025Updated last year
- ☆21Aug 25, 2024Updated last year
- Code audit (code review) with VIM.☆17Jan 3, 2025Updated last year
- Multi-granularity vulnerability detection with a novel pre-trained code model☆19Dec 15, 2025Updated 3 months ago
- Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks☆257Jan 19, 2024Updated 2 years ago
- A C/C++ Code Vulnerability Dataset with Code Changes and CVE Summaries☆358Mar 25, 2021Updated 5 years ago
- Python library for CPGQL server☆41Jun 4, 2024Updated last year
- A manually vetted dataset for security vulnerability detection in Java projects☆93Aug 12, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Source code of AsiaCCS'22 paper - RecIPE: Revisiting the Evaluation of Memory Error Defenses☆13Sep 19, 2023Updated 2 years ago
- ☆59May 10, 2024Updated last year
- Code Aware Services (CAS) is a set of tools for extracting information from a (especially large) source code trees. It consists of Build …☆62Aug 1, 2025Updated 8 months ago
- Awesome Large Language Models for Vulnerability Detection☆549Updated this week
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆176Oct 23, 2024Updated last year
- KFLAT is a tool to serialize memory of selected variables from the running Linux kernel and organize it into a single memory block of con…☆31Jan 20, 2026Updated 2 months ago
- The datasets and source code of the NDSS 2025 paper《BinEnhance: An Enhancement Framework Based on External Environment Semantics for Bina…☆30Nov 13, 2025Updated 4 months ago
- The source code of project "LLift" (Enhancing static analysis with LLM)☆86Mar 5, 2024Updated 2 years ago
- ☆50Jan 19, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Framework for testing the reachability of native functions in Android applications.☆11Aug 30, 2023Updated 2 years ago
- ☆53Jul 16, 2024Updated last year
- GPTCloneBench is a clone detection benchmark based on SemanticCloneBench and GPT.☆16Feb 5, 2025Updated last year
- An standalone execution trace library built on DynamoRIO.☆23Jul 4, 2022Updated 3 years ago
- An overview of LLMs for cybersecurity.☆1,282Mar 18, 2026Updated 3 weeks ago
- Source Code for Paper "Large Language Models are Few-Shot Summarizers: Multi-Intent Comment Generation via In-Context Learning"☆18Jun 9, 2023Updated 2 years ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆192Feb 23, 2026Updated last month