tuhh-softsec / LLMSecEvalLinks
☆54Updated last year
Alternatives and similar repositories for LLMSecEval
Users that are interested in LLMSecEval are comparing it to the libraries listed below
Sorting:
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆82Updated 2 years ago
- ☆124Updated last year
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆64Updated 7 months ago
- VulRepair: A T5-Based Automated Software Vulnerability Repair☆83Updated 6 months ago
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆53Updated 8 months ago
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆87Updated 10 months ago
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆170Updated last year
- 🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)☆42Updated 7 months ago
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆74Updated last month
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆121Updated 3 weeks ago
- Repository for PrimeVul Vulnerability Detection Dataset☆202Updated last year
- AIBugHunter: A Practical Tool for Predicting, Classifying and Repairing Software Vulnerabilities☆44Updated last year
- Automated Benchmarking of LLM Agents on Real-World Software Security Tasks [NeurIPS 2025]☆42Updated last week
- ☆49Updated last year
- CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software☆308Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆241Updated last year
- ☠️ Ground-truth dataset for vulnerability prediction (known research datasets and data sources included such as NVD, CVE Details and OSV)…☆100Updated 2 years ago
- Vul4J: A Dataset of Reproducible Java Vulnerabilities☆110Updated 3 months ago
- 🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access☆47Updated 6 months ago
- Agent Security Bench (ASB)☆149Updated last month
- ☆31Updated last year
- For our ISSTA23 paper "How Effective are Neural Networks for Fixing Security Vulnerabilities?" by Yi Wu, Nan Jiang, Hung Viet Pham, Thiba…☆40Updated 2 years ago
- Resources for our ICSE'24 poster: Prompt-Enhanced Software Vulnerability Detection Using ChatGPT.☆25Updated last year
- [2023 TDSC] Pre-trained Model-based Automated Software Vulnerability Repair: How Far are We?☆25Updated 2 years ago
- CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.☆56Updated last year
- open science repo of "Neural Transfer Learning for Repairing Security Vulnerabilities in C Code" https://arxiv.org/pdf/2104.08308☆62Updated last year
- 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…☆63Updated 3 months ago
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆48Updated 2 years ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆276Updated last week
- Simplified Source Code Pre-Training for Vulnerability Detection☆107Updated last year