fra31 / rlhf-trojan-competition-submissionLinks
☆19Updated last year
Alternatives and similar repositories for rlhf-trojan-competition-submission
Users that are interested in rlhf-trojan-competition-submission are comparing it to the libraries listed below
Sorting:
- Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]☆43Updated last year
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆64Updated last year
- ☆31Updated last year
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆69Updated last year
- ☆29Updated 10 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆27Updated 4 months ago
- ☆43Updated 2 years ago
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆76Updated last month
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆23Updated 10 months ago
- ☆54Updated 2 years ago
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆61Updated 5 months ago
- Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique☆17Updated 10 months ago
- [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)☆79Updated 8 months ago
- ☆29Updated 2 years ago
- ☆40Updated 9 months ago
- ☆19Updated 8 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 5 months ago
- NeurIPS'24 - LLM Safety Landscape☆23Updated 4 months ago
- Fluent student-teacher redteaming☆22Updated 11 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆51Updated 2 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- ☆35Updated 6 months ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆17Updated 2 months ago
- ☆44Updated 4 months ago
- ☆21Updated 5 months ago
- ☆14Updated last year
- Official Repository for Dataset Inference for LLMs☆34Updated 11 months ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆100Updated 4 months ago
- Code for paper "Universal Jailbreak Backdoors from Poisoned Human Feedback"☆55Updated last year
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆14Updated 6 months ago