Alternatives and similar repositories for Cheating-LLM-Benchmarks:

Users that are interested in Cheating-LLM-Benchmarks are comparing it to the libraries listed below

• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆60Updated 3 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆91Updated 11 months ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆23Updated 11 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆26Updated 2 months ago
• vfleaking / PTST
  Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"
  ☆18Updated last year
• rishub-tamirisa / tamper-resistance
  [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆54Updated last month
• XuandongZhao / weak-to-strong
  Weak-to-Strong Jailbreaking on Large Language Models
  ☆73Updated last year
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆89Updated 9 months ago
• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆35Updated 5 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆53Updated 3 weeks ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆66Updated 6 months ago
• boyiwei / alignment-attribution-code
  [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆76Updated 3 weeks ago
• ejones313 / auditing-llms
  ☆54Updated 2 years ago
• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆33Updated last week
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆70Updated 3 weeks ago
• Vaidehi99 / InfoDeletionAttacks
  ☆42Updated 2 months ago
• licong-lin / negative-preference-optimization
  ☆57Updated 9 months ago
• akumar2709 / OVERTHINK_public
  ☆27Updated 3 weeks ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆96Updated 2 months ago
• locuslab / acr-memorization
  ☆33Updated 4 months ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆68Updated last year
• zjysteven / mink-plus-plus
  [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆37Updated 2 months ago
• thu-coai / SafeUnlearning
  Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks
  ☆25Updated 9 months ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆35Updated 5 months ago
• Jayfeather1024 / Backdoor-Enhanced-Alignment
  ☆20Updated 4 months ago
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• OSU-NLP-Group / AgentAttack
  ☆17Updated 5 months ago
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆58Updated 6 months ago
• katiekang1998 / reasoning_generalization
  ☆31Updated 3 months ago
• VITA-Group / SEAL
  Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆15Updated 2 weeks ago