CUHK-ARISE / MAS-Resilience
Code and Results of the Paper: On the Resilience of Multi-Agent Systems with Malicious Agents
☆19Updated last month
Alternatives and similar repositories for MAS-Resilience:
Users that are interested in MAS-Resilience are comparing it to the libraries listed below
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆58Updated 2 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆90Updated 10 months ago
- Implementation for "RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content"☆20Updated 7 months ago
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆66Updated last month
- Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting☆15Updated last year
- ☆76Updated this week
- Recent papers on (1) Psychology of LLMs; (2) Biases in LLMs.☆47Updated last year
- ☆79Updated last month
- Unofficial implementation of "Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection"☆18Updated 8 months ago
- [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion☆36Updated 5 months ago
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆121Updated 8 months ago
- ☆29Updated 5 months ago
- Implementation of the paper "Exploring the Universal Vulnerability of Prompt-based Learning Paradigm" on Findings of NAACL 2022☆29Updated 2 years ago
- Official repo for "ProSec: Fortifying Code LLMs with Proactive Security Alignment"☆13Updated 3 months ago
- Benchmarking LLMs' Emotional Alignment with Humans☆96Updated last month
- [FCS'24] LVLM Safety paper☆17Updated 2 months ago
- Code for the AAAI 2023 paper "CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models☆29Updated last year
- official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries☆30Updated last week
- A lightweight library for large laguage model (LLM) jailbreaking defense.☆48Updated 5 months ago
- Multilingual safety benchmark for Large Language Models☆49Updated 6 months ago
- Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"☆27Updated 7 months ago
- ☆17Updated 5 months ago
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆95Updated last year
- Mostly recording papers about models' trustworthy applications. Intending to include topics like model evaluation & analysis, security, c…☆20Updated last year
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆127Updated 3 months ago
- ☆54Updated 2 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆63Updated 5 months ago
- [NeurIPS 2024] Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling☆26Updated 4 months ago
- Benchmarking LLMs' Gaming Ability in Multi-Agent Environments☆71Updated last month
- Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆88Updated 6 months ago