sail-sg / Cheating-LLM-BenchmarksLinks
[ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
☆81Updated 9 months ago
Alternatives and similar repositories for Cheating-LLM-Benchmarks
Users that are interested in Cheating-LLM-Benchmarks are comparing it to the libraries listed below
Sorting:
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆96Updated last year
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆64Updated 6 months ago
- ☆35Updated 7 months ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆106Updated 5 months ago
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆59Updated last month
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆18Updated last year
- A Sober Look at Language Model Reasoning☆81Updated last month
- Code for "Reasoning to Learn from Latent Thoughts"☆114Updated 4 months ago
- ☆55Updated 2 years ago
- Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆39Updated 4 months ago
- The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'☆21Updated 2 months ago
- Codebase for decoding compressed trust.☆24Updated last year
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆39Updated 9 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆29Updated 5 months ago
- ☆39Updated last year
- ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆36Updated 5 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Updated last year
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated 3 months ago
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆59Updated 10 months ago
- ☆47Updated last year
- Test-time-training on nearest neighbors for large language models☆45Updated last year
- ☆24Updated 5 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆112Updated last month
- ☆34Updated 7 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆107Updated last month
- Improving Alignment and Robustness with Circuit Breakers☆225Updated 10 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆175Updated 3 months ago
- ☆31Updated last year
- ☆51Updated 3 months ago
- ☆75Updated 6 months ago