microsoft / llmail-inject-challengeLinks
Code for the API, workload execution, and agents underlying the LLMail-Inject Adpative Prompt Injection Challenge
☆19Updated 3 months ago
Alternatives and similar repositories for llmail-inject-challenge
Users that are interested in llmail-inject-challenge are comparing it to the libraries listed below
Sorting:
- ☆35Updated 8 months ago
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆66Updated 8 months ago
- Fluent student-teacher redteaming☆23Updated last year
- ☆60Updated 2 years ago
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆116Updated last year
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆84Updated 6 months ago
- [ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs☆13Updated 7 months ago
- ☆40Updated last year
- ☆51Updated 2 years ago
- Codebase for Obfuscated Activations Bypass LLM Latent-Space Defenses☆27Updated last year
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆79Updated 5 months ago
- ☆37Updated last year
- ☆47Updated last year
- This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.☆90Updated last year
- Privacy backdoors☆50Updated last year
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Updated 9 months ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆57Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆258Updated last year
- Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]☆43Updated last year
- Code for paper "Universal Jailbreak Backdoors from Poisoned Human Feedback"☆66Updated last year
- Official implementation of the WASP web agent security benchmark☆67Updated 5 months ago
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆158Updated 8 months ago
- ☆34Updated last year
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Updated last year
- ☆122Updated 2 years ago
- ☆24Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆127Updated 11 months ago
- ☆27Updated last year
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆127Updated last year
- ☆50Updated last year