Alternatives and similar repositories for alpha-DPO

Users that are interested in alpha-DPO are comparing it to the libraries listed below

• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆45Updated 9 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆81Updated last month
• uservan / ThinkPO
  ☆18Updated last week
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆46Updated last year
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆35Updated 2 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆26Updated 3 months ago
• mathllm / Step-Controlled_DPO
  ☆22Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• EIT-NLP / Distilling-CoT-Reasoning
  [ACL 2025 Findings] Official implementation of the paper "Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning".
  ☆18Updated 5 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 6 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆59Updated 10 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆58Updated last year
• gl-ybnbxb / BoNBoN
  ☆18Updated last year
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆38Updated 2 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 3 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆77Updated 2 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆39Updated 3 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆107Updated last month
• ZhentingWang / DUMP
  ☆22Updated 3 months ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 4 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆28Updated 8 months ago
• ShuheSH / A-Survey-of-the-Reasoning-Abilities-of-LLMs
  ☆24Updated 5 months ago
• ChangyuChen347 / MaskedThought
  [ACL 2024] Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models
  ☆22Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆92Updated 2 weeks ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆108Updated 4 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆47Updated 5 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆33Updated last year
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 7 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆43Updated 3 weeks ago
• RUCKBReasoning / CodeRM
  Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'
  ☆23Updated 2 months ago