sail-sg / Cheating-LLM-BenchmarksLinks
[ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
☆83Updated 11 months ago
Alternatives and similar repositories for Cheating-LLM-Benchmarks
Users that are interested in Cheating-LLM-Benchmarks are comparing it to the libraries listed below
Sorting:
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆98Updated last year
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆65Updated 8 months ago
- NeurIPS'24 - LLM Safety Landscape☆30Updated 7 months ago
- ☆58Updated 2 years ago
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆61Updated 4 months ago
- ☆37Updated 9 months ago
- Implementation of paper 'Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference' [NeurIPS'24…☆22Updated last year
- ☆61Updated last year
- Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆42Updated 6 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆20Updated 2 weeks ago
- Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks☆31Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆116Updated 7 months ago
- ☆41Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆136Updated 3 months ago
- A Sober Look at Language Model Reasoning☆83Updated this week
- Test-time-training on nearest neighbors for large language models☆46Updated last year
- The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'☆22Updated 4 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆40Updated 11 months ago
- ☆26Updated 7 months ago
- Codebase for decoding compressed trust.☆24Updated last year
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆117Updated last year
- ☆32Updated last year
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆60Updated last year
- ☆30Updated last year
- ☆50Updated last year
- Code for "Reasoning to Learn from Latent Thoughts"☆119Updated 6 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Updated last year
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆31Updated 7 months ago
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆64Updated last year
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆84Updated 6 months ago