Alternatives and similar repositories for Mitigating-the-Alignment-Tax-of-RLHF

Users that are interested in Mitigating-the-Alignment-Tax-of-RLHF are comparing it to the libraries listed below

• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆37Updated 6 months ago
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆62Updated last year
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆29Updated last year
• yihuaihong / ConceptVectors
  [EMNLP 2025 Main] ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"
  ☆38Updated 3 months ago
• NUS-TRAIL / Unnatural_Language
  The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'
  ☆23Updated 6 months ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆61Updated 2 years ago
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆63Updated last year
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆25Updated last year
• VITA-Group / SEAL
  [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆45Updated 7 months ago
• princeton-nlp / benign-data-breaks-safety
  ☆41Updated last year
• licong-lin / negative-preference-optimization
  ☆68Updated last year
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆17Updated last year
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆46Updated last year
• zjysteven / mink-plus-plus
  [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆50Updated 6 months ago
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆19Updated last year
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆82Updated 11 months ago
• swj0419 / muse_bench
  ☆30Updated 8 months ago
• which47 / LLMCL
  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  ☆36Updated last year
• deeplearning-wisc / picle
  Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)
  ☆26Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• milesaturpin / cot-unfaithfulness
  ☆51Updated 2 years ago
• jinzhuoran / RWKU
  RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024
  ☆86Updated last year
• weixuan-wang123 / SADI
  ☆13Updated 2 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆69Updated last year
• uiuctml / Localize-and-Stitch
  Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
  ☆30Updated 2 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆98Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆84Updated 8 months ago
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆76Updated last year
• keven980716 / weak-to-strong-deception
  [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆13Updated last year
• tanganke / opcm
  official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"
  ☆22Updated last month