Alternatives and similar repositories for alpha-DPO

Users that are interested in alpha-DPO are comparing it to the libraries listed below

• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆49Updated last year
• uservan / ThinkPO
  ☆17Updated 3 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆89Updated last week
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 7 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆52Updated last year
• Infini-AI-Lab / GRESO
  ☆66Updated 5 months ago
• sail-sg / feedback-conditional-policy
  Code for "Language Models Can Learn from Verbal Feedback Without Scalar Rewards"
  ☆52Updated 2 months ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆69Updated 7 months ago
• rookie-joe / AutoPSV
  ☆51Updated last year
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆48Updated 6 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆93Updated last year
• EIT-NLP / Distilling-CoT-Reasoning
  [ACL 2025 Findings] Official implementation of the paper "Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning".
  ☆19Updated 9 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆51Updated 9 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆45Updated 2 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆142Updated 4 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆72Updated 7 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆127Updated 8 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆47Updated 4 months ago
• sail-sg / ActivePRM
  ☆19Updated 7 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆58Updated last year
• princeton-pli / what-makes-good-rm
  [NeurIPS 2025] What Makes a Reward Model a Good Teacher? An Optimization Perspective
  ☆40Updated 2 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆105Updated last month
• ZhentingWang / DUMP
  ☆32Updated 6 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆57Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆56Updated 2 years ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆63Updated 11 months ago
• mathllm / Step-Controlled_DPO
  ☆23Updated last year
• lemon-prog123 / LongRePS
  Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision
  ☆16Updated 7 months ago
• ECNU-ICALK / MELO
  [AAAI 2024] MELO: Enhancing Model Editing with Neuron-indexed Dynamic LoRA
  ☆26Updated last year