sail-sg / Cheating-LLM-Benchmarks
[ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
☆72Updated 4 months ago
Alternatives and similar repositories for Cheating-LLM-Benchmarks:
Users that are interested in Cheating-LLM-Benchmarks are comparing it to the libraries listed below
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆89Updated 9 months ago
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆56Updated last month
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆25Updated last week
- ☆37Updated last week
- Codebase for decoding compressed trust.☆23Updated 9 months ago
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆74Updated 7 months ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆33Updated 3 months ago
- ☆30Updated 2 months ago
- ☆53Updated last year
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆42Updated 7 months ago
- ☆41Updated 3 weeks ago
- ☆21Updated 8 months ago
- ☆37Updated last year
- Weak-to-Strong Jailbreaking on Large Language Models☆72Updated last year
- ☆17Updated 4 months ago
- ☆67Updated last week
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆71Updated this week
- ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆32Updated 2 weeks ago
- [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?☆64Updated last month
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆49Updated 4 months ago
- ☆25Updated 9 months ago
- ☆30Updated 5 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆101Updated 11 months ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆18Updated 11 months ago
- ☆12Updated 11 months ago
- [ICLR 2025] Dissecting Adversarial Robustness of Multimodal LM Agents☆68Updated last week
- This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen,…☆45Updated 2 months ago
- ☆41Updated 2 years ago
- ☆32Updated last year
- The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…☆40Updated last month