fra31 / rlhf-trojan-competition-submission
☆17Updated last year
Alternatives and similar repositories for rlhf-trojan-competition-submission:
Users that are interested in rlhf-trojan-competition-submission are comparing it to the libraries listed below
- ☆31Updated last year
- ☆42Updated 2 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆68Updated last year
- [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)☆77Updated 6 months ago
- ☆54Updated 2 years ago
- official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries☆33Updated last week
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆62Updated last year
- ☆42Updated 2 years ago
- [ICLR 2025] Dissecting Adversarial Robustness of Multimodal LM Agents☆82Updated 2 months ago
- ☆33Updated 4 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 3 months ago
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆60Updated 3 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- ☆18Updated 6 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆26Updated 2 months ago
- ☆11Updated 2 weeks ago
- NeurIPS'24 - LLM Safety Landscape☆22Updated 2 months ago
- Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]☆43Updated last year
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 5 months ago
- ☆29Updated last year
- Official Repository for Dataset Inference for LLMs☆33Updated 9 months ago
- ☆16Updated last year
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆44Updated 3 weeks ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆91Updated 11 months ago
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆19Updated 8 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆18Updated last year
- ☆20Updated 4 months ago
- ☆42Updated last year
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆13Updated 4 months ago
- Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks☆25Updated 9 months ago