Alternatives and similar repositories for Cheating-LLM-Benchmarks

Users that are interested in Cheating-LLM-Benchmarks are comparing it to the libraries listed below

• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆61Updated 4 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆93Updated last year
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆27Updated 3 months ago
• vfleaking / PTST
  Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"
  ☆18Updated last year
• ejones313 / auditing-llms
  ☆54Updated 2 years ago
• rishub-tamirisa / tamper-resistance
  [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆56Updated 3 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆31Updated last year
• zhxieml / remiss-jailbreak
  ☆30Updated 11 months ago
• locuslab / acr-memorization
  ☆34Updated 5 months ago
• yihuaihong / ConceptVectors
  ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"
  ☆35Updated 3 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆52Updated last week
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆97Updated 3 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆87Updated 6 months ago
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆76Updated last month
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆55Updated 11 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆44Updated 3 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆85Updated 7 months ago
• NUS-TRAIL / Unnatural_Language
  The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'
  ☆17Updated 2 weeks ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆35Updated 7 months ago
• lmarena / PPE
  ☆48Updated 3 weeks ago
• boyiwei / alignment-attribution-code
  [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆79Updated 2 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆89Updated last week
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆69Updated last year
• MadryLab / DsDm
  ☆49Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated last month
• activatedgeek / calibration-tuning
  ☆51Updated last month
• technion-cs-nlp / LLMsKnow
  ☆70Updated 4 months ago
• jiahai-feng / binding-iclr
  ☆14Updated last year
• SALT-NLP / PopupAttack
  Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups
  ☆32Updated 5 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆72Updated 2 months ago