Alternatives and similar repositories for SelectiveDPO:

Users that are interested in SelectiveDPO are comparing it to the libraries listed below

• tmlr-group / NoisyRationales
  [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"
  ☆35Updated 2 months ago
• Purshow / Awesome-LVLM-Hallucination
  ☆45Updated 4 months ago
• Lingkai-Kong / RE-Control
  Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective
  ☆25Updated 2 months ago
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆83Updated 8 months ago
• uiuctml / Localize-and-Stitch
  Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
  ☆23Updated 2 months ago
• guyuntian / CoT_benchmark
  Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"
  ☆19Updated last year
• ZFancy / awesome-activation-engineering
  A curated list of resources for activation engineering
  ☆52Updated 3 weeks ago
• boyiwei / alignment-attribution-code
  [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆73Updated last month
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆72Updated 7 months ago
• git-disl / Booster
  This is the official code for the paper "Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturba…
  ☆21Updated last week
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆42Updated 5 months ago
• jinhaoduan / SAR
  [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
  ☆46Updated 6 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆72Updated 5 months ago
• NOVAglow646 / OOD-Generalization-Paper-Reading-Notes
  OOD Generalization相关文章的阅读笔记
  ☆32Updated 3 months ago
• kokolerk / R1-V-GUI-agent
  ☆13Updated this week
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆50Updated last year
• warriors-30 / SFAT-paddle
  ☆24Updated last year
• shenlei515 / VHL-paddle
  translation of VHL repo in paddle
  ☆25Updated last year
• tmlr-group / MC-GRA
  [ICML 2023] "On Strengthening and Defending Graph Reconstruction Attack with Markov Chain Approximation"
  ☆32Updated last year
• Persdre / NeurIPS-2024-LLM-Papers
  Accepted LLM Papers in NeurIPS 2024
  ☆34Updated 5 months ago
• keven980716 / weak-to-strong-deception
  [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆13Updated 9 months ago
• Alsace08 / Chain-of-Embedding
  [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
  ☆41Updated 3 months ago
• git-disl / Safety-Tax
  This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".
  ☆12Updated 3 weeks ago
• xydaytoy / EVA
  ☆13Updated 11 months ago
• TrustGen / TrustEval-toolkit
  TrustEval: A modular and extensible toolkit for comprehensive trust evaluation of generative foundation models (GenFMs)
  ☆90Updated this week
• jinzhuoran / RWKU
  RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024
  ☆69Updated 6 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆53Updated last month
• VLKEB / VLKEB
  ☆51Updated 5 months ago
• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆19Updated 5 months ago
• thu-ml / STAIR
  Official codebase for "STAIR: Improving Safety Alignment with Introspective Reasoning"
  ☆28Updated last month