SproutNan / AI-Safety_SCAV
This is the code repository for "Uncovering Safety Risks of Large Language Models through Concept Activation Vector"
☆10Updated last week
Related projects ⓘ
Alternatives and complementary repositories for AI-Safety_SCAV
- [ACL 2024] Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization☆13Updated 4 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆45Updated last month
- Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"☆36Updated 4 months ago
- ☆36Updated 4 months ago
- A survey on harmful fine-tuning attack for large language model☆81Updated this week
- [ACL2024-Main] Data and Code for WaterBench: Towards Holistic Evaluation of LLM Watermarks☆18Updated last year
- ☆16Updated 4 months ago
- [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion☆29Updated last month
- ☆54Updated 3 weeks ago
- Code and data for paper "A Semantic Invariant Robust Watermark for Large Language Models" accepted by ICLR 2024.☆25Updated last week
- ☆30Updated 5 months ago
- ☆18Updated last month
- Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT☆26Updated last year
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆19Updated last week
- Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆73Updated 2 months ago
- A curated list of trustworthy Generative AI papers. Daily updating...☆67Updated 2 months ago
- Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆60Updated last month
- ☆38Updated last year
- Data for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder"☆18Updated last year
- An LLM can Fool Itself: A Prompt-Based Adversarial Attack (ICLR 2024)☆56Updated 4 months ago
- Official Repo of ICLR 24 BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models☆17Updated 4 months ago
- Submission Guide + Discussion Board for AI Singapore Global Challenge for Safe and Secure LLMs (Track 1A).☆16Updated 4 months ago
- ☆28Updated 5 months ago
- Repository for Towards Codable Watermarking for Large Language Models☆29Updated last year
- A lightweight library for large laguage model (LLM) jailbreaking defense.☆39Updated last month
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆29Updated 4 months ago
- ☆46Updated 5 months ago
- Code and data of the ACL-IJCNLP 2021 paper "Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger"☆37Updated 2 years ago
- ☆21Updated last month
- ☆26Updated 3 months ago