sail-sg / Cheating-LLM-Benchmarks
[SafeGenAi @ NeurIPS 2024] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates
☆60Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for Cheating-LLM-Benchmarks
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆48Updated 3 months ago
- [ATTRIB @ NeurIPS 2024] When Attention Sink Emerges in Language Models: An Empirical View☆29Updated last month
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆84Updated 5 months ago
- Codebase for decoding compressed trust.☆20Updated 6 months ago
- ☆38Updated last year
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆28Updated 4 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆64Updated 8 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆17Updated 8 months ago
- ☆26Updated 3 weeks ago
- [Arxiv 2024] Adversarial attacks on multimodal agents☆39Updated 4 months ago
- ☆10Updated 8 months ago
- ☆14Updated 6 months ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆14Updated 6 months ago
- Intriguing Properties of Data Attribution on Diffusion Models (ICLR 2024)☆23Updated 9 months ago
- ☆49Updated last year
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆57Updated 9 months ago
- Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks☆21Updated 4 months ago
- ☆20Updated 4 months ago
- ☆50Updated 2 weeks ago
- ☆31Updated last year
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆39Updated 3 months ago
- ☆21Updated last month
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆26Updated 2 weeks ago
- Does Refusal Training in LLMs Generalize to the Past Tense? [NeurIPS 2024 Safe Generative AI Workshop (Oral)]☆57Updated last month
- The repository contains code for Adaptive Data Optimization☆18Updated last month
- Landing Page for TOFU☆98Updated 5 months ago
- ☆13Updated last month
- [ArXiv 2024] Denial-of-Service Poisoning Attacks on Large Language Models☆13Updated 3 weeks ago
- ☆35Updated 4 months ago
- Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆59Updated last month