SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and reasoning capabilities) of LLMs for vulnerability detection.
☆67May 4, 2025Updated last year
Alternatives and similar repositories for SecLLMHolmes
Users that are interested in SecLLMHolmes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jun 5, 2024Updated 2 years ago
- Repository for PrimeVul Vulnerability Detection Dataset☆272Sep 7, 2024Updated 2 years ago
- ☆40Jun 23, 2025Updated last year
- SeqTrans: Automatic Vulnerability Fix via Sequence to Sequence Learning☆17Mar 9, 2022Updated 4 years ago
- [ICSE'24 Industry Challenge Track] "ReposVul: A Repository-Level High-Quality Vulnerability Dataset".☆111Nov 24, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆42Mar 20, 2025Updated last year
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆79Oct 29, 2025Updated 10 months ago
- ☆231Jul 25, 2024Updated 2 years ago
- Source code for LLMxCPG paper☆163Mar 26, 2026Updated 5 months ago
- A continuously updated collection of papers on agentic SE☆637Jul 17, 2026Updated 2 months ago
- Out of Distribution, Out of Luck: How Well Can LLMs Trained on Vulnerability Datasets Detect Top 25 CWE Weaknesses?☆22Jan 23, 2026Updated 7 months ago
- Multi-granularity vulnerability detection with a novel pre-trained code model☆19Dec 15, 2025Updated 9 months ago
- (NDSS 2024) Optimizing Decompiler Output with LLM☆131Sep 8, 2024Updated 2 years ago
- A Transformer-based Line-Level Vulnerability Prediction☆177Aug 5, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code audit (code review) with VIM.☆17Jan 3, 2025Updated last year
- ☆22Aug 25, 2024Updated 2 years ago
- Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks☆265Jan 19, 2024Updated 2 years ago
- A C/C++ Code Vulnerability Dataset with Code Changes and CVE Summaries☆368Mar 25, 2021Updated 5 years ago
- ☆16Nov 24, 2023Updated 2 years ago
- ☆60May 10, 2024Updated 2 years ago
- The replication package of paper "Pre-training by Predicting Program Dependencies for Vulnerability Analysis Tasks"☆28Jan 3, 2024Updated 2 years ago
- R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation☆18Aug 5, 2025Updated last year
- [ACL 2026 Main] SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios☆20Jun 28, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code Aware Services (CAS) is a set of tools for extracting information from a (especially large) source code trees. It consists of Build …☆63Aug 1, 2025Updated last year
- ☆116Aug 6, 2026Updated last month
- KFLAT is a tool to serialize memory of selected variables from the running Linux kernel and organize it into a single memory block of con…☆32Jan 20, 2026Updated 8 months ago
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆191Oct 23, 2024Updated last year
- Simultaneous evaluation on both functionality and security of LLM-generated code.☆44Jul 30, 2026Updated last month
- [EMSE'26] An Empirical Study on the Effectiveness of Large Language Models for Binary Code Understanding☆15Aug 19, 2025Updated last year
- The source code of project "LLift" (Enhancing static analysis with LLM)☆88Mar 5, 2024Updated 2 years ago
- An standalone execution trace library built on DynamoRIO.☆23Jul 4, 2022Updated 4 years ago
- The datasets and source code of the NDSS 2025 paper《BinEnhance: An Enhancement Framework Based on External Environment Semantics for Bina…☆30Nov 13, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆158Jan 12, 2025Updated last year
- Framework for testing the reachability of native functions in Android applications.☆11Aug 30, 2023Updated 3 years ago
- ☆52Jan 19, 2019Updated 7 years ago
- GPTCloneBench is a clone detection benchmark based on SemanticCloneBench and GPT.☆15Feb 5, 2025Updated last year
- Python library for CPGQL server☆45Jun 4, 2024Updated 2 years ago
- Hey folks, this is a repository for papers on LLM for Vuln. Detection area☆91Apr 2, 2025Updated last year
- Source Code for Paper "Large Language Models are Few-Shot Summarizers: Multi-Intent Comment Generation via In-Context Learning"☆19Jun 9, 2023Updated 3 years ago