brian-lou / Training-Data-Extraction-Attack-on-LLMs
This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content using perplexity, perturbation scoring metrics, and large scale search queries.
☆12Updated last year
Alternatives and similar repositories for Training-Data-Extraction-Attack-on-LLMs:
Users that are interested in Training-Data-Extraction-Attack-on-LLMs are comparing it to the libraries listed below
- Whispers in the Machine: Confidentiality in LLM-integrated Systems☆36Updated last month
- A survey of privacy problems in Large Language Models (LLMs). Contains summary of the corresponding paper along with relevant code☆67Updated 10 months ago
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆116Updated 2 weeks ago
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆52Updated 8 months ago
- ☆44Updated 2 years ago
- LLM security and privacy☆48Updated 6 months ago
- ☆54Updated 4 months ago
- The repository contains the code for analysing the leakage of personally identifiable (PII) information from the output of next word pred…☆92Updated 8 months ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆148Updated 3 weeks ago
- LLM Self Defense: By Self Examination, LLMs know they are being tricked☆32Updated 11 months ago
- A curated list of trustworthy Generative AI papers. Daily updating...☆71Updated 7 months ago
- Unofficial implementation of "Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection"☆18Updated 9 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆70Updated 7 months ago
- The code for paper "The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)", exploring the privacy risk o…☆46Updated 2 months ago
- ☆128Updated 7 months ago
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆62Updated last year
- BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks on Large Language Models☆134Updated 2 months ago
- ☆38Updated last month
- ☆20Updated 3 months ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆50Updated 8 months ago
- AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks☆45Updated 10 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆68Updated last year
- ☆170Updated last year
- This repository provides a benchmark for prompt Injection attacks and defenses☆188Updated last week
- Code to conduct an embedding attack on LLMs☆24Updated 3 months ago
- Python package for measuring memorization in LLMs.☆152Updated 5 months ago
- Code for Findings-ACL 2023 paper: Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Rec…☆45Updated 10 months ago
- Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"☆36Updated 9 months ago
- The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…☆102Updated 3 months ago
- ☆26Updated last year