SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and reasoning capabilities) of LLMs for vulnerability detection.
☆65May 4, 2025Updated last year
Alternatives and similar repositories for SecLLMHolmes
Users that are interested in SecLLMHolmes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jun 5, 2024Updated 2 years ago
- Repository for PrimeVul Vulnerability Detection Dataset☆257Sep 7, 2024Updated last year
- ☆40Jun 23, 2025Updated last year
- SeqTrans: Automatic Vulnerability Fix via Sequence to Sequence Learning☆17Mar 9, 2022Updated 4 years ago
- [ICSE'24 Industry Challenge Track] "ReposVul: A Repository-Level High-Quality Vulnerability Dataset".☆109Nov 24, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆42Mar 20, 2025Updated last year
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆77Oct 29, 2025Updated 8 months ago
- ☆230Jul 25, 2024Updated last year
- Source code for LLMxCPG paper☆157Mar 26, 2026Updated 3 months ago
- A continuously updated collection of papers on agentic SE☆631Updated this week
- Out of Distribution, Out of Luck: How Well Can LLMs Trained on Vulnerability Datasets Detect Top 25 CWE Weaknesses?☆21Jan 23, 2026Updated 5 months ago
- Multi-granularity vulnerability detection with a novel pre-trained code model☆19Dec 15, 2025Updated 7 months ago
- (NDSS 2024) Optimizing Decompiler Output with LLM☆131Sep 8, 2024Updated last year
- A Transformer-based Line-Level Vulnerability Prediction☆174Aug 5, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code audit (code review) with VIM.☆17Jan 3, 2025Updated last year
- ☆22Aug 25, 2024Updated last year
- Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks☆266Jan 19, 2024Updated 2 years ago
- [ACL 2026 Main] SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios☆17Jun 28, 2026Updated 3 weeks ago
- A C/C++ Code Vulnerability Dataset with Code Changes and CVE Summaries☆366Mar 25, 2021Updated 5 years ago
- ☆16Nov 24, 2023Updated 2 years ago
- Source code of AsiaCCS'22 paper - RecIPE: Revisiting the Evaluation of Memory Error Defenses☆14Sep 19, 2023Updated 2 years ago
- ☆60May 10, 2024Updated 2 years ago
- The replication package of paper "Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks"☆28Jan 3, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation☆16Aug 5, 2025Updated 11 months ago
- Code Aware Services (CAS) is a set of tools for extracting information from a (especially large) source code trees. It consists of Build …☆63Aug 1, 2025Updated 11 months ago
- ☆106Jun 15, 2026Updated last month
- KFLAT is a tool to serialize memory of selected variables from the running Linux kernel and organize it into a single memory block of con…☆32Jan 20, 2026Updated 6 months ago
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆187Oct 23, 2024Updated last year
- Simultaneous evaluation on both functionality and security of LLM-generated code.☆43Updated this week
- [EMSE'26] An Empirical Study on the Effectiveness of Large Language Models for Binary Code Understanding☆15Aug 19, 2025Updated 11 months ago
- The source code of project "LLift" (Enhancing static analysis with LLM)☆87Mar 5, 2024Updated 2 years ago
- An standalone execution trace library built on DynamoRIO.☆23Jul 4, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The datasets and source code of the NDSS 2025 paper《BinEnhance: An Enhancement Framework Based on External Environment Semantics for Bina…☆30Nov 13, 2025Updated 8 months ago
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆152Jan 12, 2025Updated last year
- ☆55Jul 16, 2024Updated 2 years ago
- Framework for testing the reachability of native functions in Android applications.☆11Aug 30, 2023Updated 2 years ago
- ☆52Jan 19, 2019Updated 7 years ago
- GPTCloneBench is a clone detection benchmark based on SemanticCloneBench and GPT.☆15Feb 5, 2025Updated last year
- Python library for CPGQL server☆43Jun 4, 2024Updated 2 years ago