SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and reasoning capabilities) of LLMs for vulnerability detection.
☆67May 4, 2025Updated last year
Alternatives and similar repositories for SecLLMHolmes
Users that are interested in SecLLMHolmes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jun 5, 2024Updated 2 years ago
- Repository for PrimeVul Vulnerability Detection Dataset☆268Sep 7, 2024Updated last year
- ☆40Jun 23, 2025Updated last year
- SeqTrans: Automatic Vulnerability Fix via Sequence to Sequence Learning☆17Mar 9, 2022Updated 4 years ago
- [ICSE'24 Industry Challenge Track] "ReposVul: A Repository-Level High-Quality Vulnerability Dataset".☆109Nov 24, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆42Mar 20, 2025Updated last year
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆77Oct 29, 2025Updated 10 months ago
- ☆231Jul 25, 2024Updated 2 years ago
- Source code for LLMxCPG paper☆161Mar 26, 2026Updated 5 months ago
- A continuously updated collection of papers on agentic SE☆633Jul 17, 2026Updated last month
- Out of Distribution, Out of Luck: How Well Can LLMs Trained on Vulnerability Datasets Detect Top 25 CWE Weaknesses?☆21Jan 23, 2026Updated 7 months ago
- Multi-granularity vulnerability detection with a novel pre-trained code model☆19Dec 15, 2025Updated 8 months ago
- (NDSS 2024) Optimizing Decompiler Output with LLM☆131Sep 8, 2024Updated last year
- A Transformer-based Line-Level Vulnerability Prediction☆175Aug 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code audit (code review) with VIM.☆17Jan 3, 2025Updated last year
- ☆22Aug 25, 2024Updated 2 years ago
- Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks☆265Jan 19, 2024Updated 2 years ago
- [ACL 2026 Main] SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios☆19Jun 28, 2026Updated 2 months ago
- A C/C++ Code Vulnerability Dataset with Code Changes and CVE Summaries☆369Mar 25, 2021Updated 5 years ago
- ☆16Nov 24, 2023Updated 2 years ago
- Source code of AsiaCCS'22 paper - RecIPE: Revisiting the Evaluation of Memory Error Defenses☆14Sep 19, 2023Updated 2 years ago
- ☆60May 10, 2024Updated 2 years ago
- The replication package of paper "Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks"☆28Jan 3, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation☆17Aug 5, 2025Updated last year
- Code Aware Services (CAS) is a set of tools for extracting information from a (especially large) source code trees. It consists of Build …☆63Aug 1, 2025Updated last year
- ☆112Aug 6, 2026Updated 3 weeks ago
- KFLAT is a tool to serialize memory of selected variables from the running Linux kernel and organize it into a single memory block of con…☆32Jan 20, 2026Updated 7 months ago
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆190Oct 23, 2024Updated last year
- Simultaneous evaluation on both functionality and security of LLM-generated code.☆44Jul 30, 2026Updated last month
- [EMSE'26] An Empirical Study on the Effectiveness of Large Language Models for Binary Code Understanding☆15Aug 19, 2025Updated last year
- The source code of project "LLift" (Enhancing static analysis with LLM)☆88Mar 5, 2024Updated 2 years ago
- An standalone execution trace library built on DynamoRIO.☆23Jul 4, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The datasets and source code of the NDSS 2025 paper《BinEnhance: An Enhancement Framework Based on External Environment Semantics for Bina…☆30Nov 13, 2025Updated 9 months ago
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆155Jan 12, 2025Updated last year
- ☆55Jul 16, 2024Updated 2 years ago
- Framework for testing the reachability of native functions in Android applications.☆11Aug 30, 2023Updated 3 years ago
- ☆52Jan 19, 2019Updated 7 years ago
- GPTCloneBench is a clone detection benchmark based on SemanticCloneBench and GPT.☆15Feb 5, 2025Updated last year
- Python library for CPGQL server☆45Jun 4, 2024Updated 2 years ago