CUHK-ARISE / MAS-ResilienceLinks
Code and Results of the Paper: On the Resilience of Multi-Agent Systems with Malicious Agents
☆24Updated 5 months ago
Alternatives and similar repositories for MAS-Resilience
Users that are interested in MAS-Resilience are comparing it to the libraries listed below
Sorting:
- ☆92Updated 2 months ago
- Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"☆29Updated 11 months ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆61Updated last month
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆137Updated 11 months ago
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆142Updated 7 months ago
- LLM Unlearning☆171Updated last year
- Implementation of the paper "Exploring the Universal Vulnerability of Prompt-based Learning Paradigm" on Findings of NAACL 2022☆29Updated 3 years ago
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆80Updated 2 months ago
- 【ACL 2024】 SALAD benchmark & MD-Judge☆154Updated 4 months ago
- A lightweight library for large laguage model (LLM) jailbreaking defense.☆52Updated 9 months ago
- ☆50Updated last year
- Mostly recording papers about models' trustworthy applications. Intending to include topics like model evaluation & analysis, security, c…☆21Updated 2 years ago
- ☆93Updated 5 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆81Updated 9 months ago
- JAILJUDGE: A comprehensive evaluation benchmark which includes a wide range of risk scenarios with complex malicious prompts (e.g., synth…☆47Updated 7 months ago
- [FCS'24] LVLM Safety paper☆18Updated 6 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆94Updated last year
- A survey on harmful fine-tuning attack for large language model☆193Updated 2 weeks ago
- Code and data of the EMNLP 2022 paper "Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversaria…☆52Updated 2 years ago
- [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey☆104Updated 11 months ago
- An LLM can Fool Itself: A Prompt-Based Adversarial Attack (ICLR 2024)☆92Updated 5 months ago
- official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries☆43Updated last month
- [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents☆42Updated last week
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆130Updated 3 months ago
- Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆92Updated last month
- ☆33Updated 9 months ago
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873☆157Updated last year
- RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024☆77Updated 9 months ago
- Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT☆33Updated last year
- Toolkit for evaluating the trustworthiness of generative foundation models.☆106Updated 3 weeks ago