sail-sg / Cheating-LLM-Benchmarks
[SafeGenAi @ NeurIPS 2024] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates
☆59Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for Cheating-LLM-Benchmarks
- [ATTRIB @ NeurIPS 2024] When Attention Sink Emerges in Language Models: An Empirical View☆27Updated 3 weeks ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆83Updated 5 months ago
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆46Updated 3 months ago
- Codebase for decoding compressed trust.☆20Updated 6 months ago
- [Arxiv 2024] Adversarial attacks on multimodal agents☆38Updated 4 months ago
- ☆49Updated last year
- ☆38Updated last year
- ☆31Updated last year
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆26Updated last week
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆57Updated 9 months ago
- Intriguing Properties of Data Attribution on Diffusion Models (ICLR 2024)☆23Updated 9 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆63Updated 8 months ago
- ☆26Updated 2 weeks ago
- ☆43Updated 9 months ago
- Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks☆21Updated 4 months ago
- Weak-to-Strong Jailbreaking on Large Language Models☆64Updated 8 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆49Updated 2 weeks ago
- Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆58Updated last month
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆26Updated 4 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs?☆23Updated 5 months ago
- ☆34Updated 3 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆17Updated 8 months ago
- The repository contains code for Adaptive Data Optimization☆18Updated 3 weeks ago
- [NeurIPS 2024] Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling☆18Updated this week
- ☆15Updated last week
- ☆33Updated last year
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆12Updated 3 months ago
- Does Refusal Training in LLMs Generalize to the Past Tense? [NeurIPS 2024 Safe Generative AI Workshop (Oral)]☆55Updated 3 weeks ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆39Updated 3 months ago
- ☆76Updated 2 weeks ago