Alternatives and similar repositories for alpha-DPO

Users that are interested in alpha-DPO are comparing it to the libraries listed below

• uservan / ThinkPO
  ☆18Updated 2 months ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆49Updated 11 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆84Updated last week
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆51Updated last year
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆124Updated 7 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 6 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆128Updated 3 months ago
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆35Updated last year
• ZhentingWang / DUMP
  ☆30Updated 5 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆44Updated 3 weeks ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 6 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 8 months ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆63Updated 3 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆102Updated last week
• mathllm / Step-Controlled_DPO
  ☆22Updated last year
• sail-sg / feedback-conditional-policy
  Code for "Language Models Can Learn from Verbal Feedback Without Scalar Rewards"
  ☆46Updated 3 weeks ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆41Updated 5 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆69Updated 5 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆46Updated last year
• wizard-III / ArcherCodeR
  ArcherCodeR is an open-source initiative enhancing code reasoning in large language models through scalable, rule-governed reinforcement …
  ☆42Updated 2 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 8 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆89Updated this week
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆54Updated 4 months ago
• thu-wyz / inference_scaling
  ☆74Updated 11 months ago
• EIT-NLP / Distilling-CoT-Reasoning
  [ACL 2025 Findings] Official implementation of the paper "Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning".
  ☆19Updated 7 months ago
• princeton-pli / what-makes-good-rm
  [NeurIPS 2025] What Makes a Reward Model a Good Teacher? An Optimization Perspective
  ☆38Updated last month
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆148Updated 8 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆50Updated 8 months ago