pipilurj / MLLM-protector
The official repository for paper "MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance"
☆31Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for MLLM-protector
- Code for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder" in NMI.☆43Updated 11 months ago
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆45Updated 2 months ago
- [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"☆66Updated 11 months ago
- ☆27Updated last year
- [ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.☆44Updated 2 months ago
- This is the official repo of the paper "Latent Guard: a Safety Framework for Text-to-image Generation"☆35Updated 2 weeks ago
- AnyDoor: Test-Time Backdoor Attacks on Multimodal Large Language Models☆43Updated 7 months ago
- [ECCV 2024] The official code for "AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shi…☆42Updated 3 months ago
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆41Updated 3 months ago
- The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?☆18Updated last week
- Evaluate robustness of adaptation methods on large vision-language models☆17Updated last year
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆26Updated 4 months ago
- [Arxiv 2024] Adversarial attacks on multimodal agents☆37Updated 4 months ago
- ☆38Updated last year
- Official Code for ACL 2024 paper "GradSafe: Detecting Unsafe Prompts for LLMs via Safety-Critical Gradient Analysis"☆38Updated 2 weeks ago
- Accepted by ECCV 2024☆71Updated 3 weeks ago
- ☆27Updated 9 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆42Updated 4 months ago
- ECSO (Make MLLM safe without neither training nor any external models!) (https://arxiv.org/abs/2403.09572)☆14Updated last week
- Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models"☆55Updated last year
- Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"☆28Updated this week
- ☆24Updated 3 months ago
- ☆18Updated this week
- ☆30Updated 4 months ago
- ☆19Updated last month
- Official implementation of NeurIPS'24 paper "Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Model…☆23Updated this week
- ☆31Updated 9 months ago
- Official PyTorch implementation of "CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learning" @ ICCV 2023☆28Updated 10 months ago
- Code for Debiasing Vision-Language Models via Biased Prompts☆53Updated last year
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆13Updated last month