brian-lou / Training-Data-Extraction-Attack-on-LLMsLinks
This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content using perplexity, perturbation scoring metrics, and large scale search queries.
☆15Updated 2 years ago
Alternatives and similar repositories for Training-Data-Extraction-Attack-on-LLMs
Users that are interested in Training-Data-Extraction-Attack-on-LLMs are comparing it to the libraries listed below
Sorting:
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Updated 2 years ago
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆66Updated last year
- Whispers in the Machine: Confidentiality in Agentic Systems☆41Updated last month
- AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks☆63Updated 7 months ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆179Updated 9 months ago
- ☆114Updated 8 months ago
- The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…☆150Updated 4 months ago
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆373Updated 2 months ago
- ☆112Updated last month
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆56Updated last year
- [ACL24] Official Repo of Paper `ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs`☆90Updated 4 months ago
- Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique☆18Updated last year
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆157Updated last year
- Implementation for "RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content"☆22Updated last year
- LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins☆29Updated last year
- Prompt Injection & Prevention techniques. Secure your AI Chatbots built using LLMs.☆14Updated last year
- ☆159Updated last year
- Unofficial implementation of "Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection"☆27Updated last year
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆373Updated 11 months ago
- Automated Safety Testing of Large Language Models☆17Updated 11 months ago
- ☆190Updated 2 years ago
- LLM security and privacy☆53Updated last year
- [Findings of ACL 2023] Bridge the Gap Between CV and NLP! A Optimization-based Textual Adversarial Attack Framework.☆14Updated 2 years ago
- TrustAgent: Towards Safe and Trustworthy LLM-based Agents☆55Updated 11 months ago
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆176Updated last year
- ☆75Updated last year
- Automatically Update LLM-Agent Papers Daily using Github Actions (Update Every 12th hours)☆19Updated last week
- ☆39Updated 2 years ago
- Create a knowledge graph out of unstructed legal text - use said knowledge graph in a graph augmented retrieval augmented generation pipe…☆64Updated last year
- [ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.☆38Updated 10 months ago