Alternatives and similar repositories for alpha-DPO

Users that are interested in alpha-DPO are comparing it to the libraries listed below

• uservan / ThinkPO
  ☆17Updated 3 months ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆49Updated last year
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆87Updated last month
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆52Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• PorUna-byte / PAR
  ☆20Updated 2 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆127Updated 7 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆42Updated 5 months ago
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆57Updated 5 months ago
• ZhentingWang / DUMP
  ☆32Updated 6 months ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆67Updated 7 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆45Updated last month
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 7 months ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• EIT-NLP / Distilling-CoT-Reasoning
  [ACL 2025 Findings] Official implementation of the paper "Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning".
  ☆19Updated 8 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 11 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆57Updated last year
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆91Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆103Updated 3 weeks ago
• sail-sg / feedback-conditional-policy
  Code for "Language Models Can Learn from Verbal Feedback Without Scalar Rewards"
  ☆51Updated last month
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆132Updated 4 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆71Updated 6 months ago
• mathllm / Step-Controlled_DPO
  ☆23Updated last year
• LAMDASZ-ML / Self-Backtracking
  ☆50Updated 8 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 9 months ago
• xiatingyu / SFT-DataSelection-at-scale
  ☆30Updated 9 months ago
• abdelfattah-lab / SplitReason
  ☆19Updated 4 months ago
• princeton-pli / what-makes-good-rm
  [NeurIPS 2025] What Makes a Reward Model a Good Teacher? An Optimization Perspective
  ☆39Updated last month
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆47Updated 3 months ago