Alternatives and similar repositories for alpha-DPO

Users that are interested in alpha-DPO are comparing it to the libraries listed below

• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆45Updated 7 months ago
• uservan / ThinkPO
  ☆19Updated 3 months ago
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆21Updated this week
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆22Updated 3 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆52Updated this week
• SteveKGYang / MetaAligner
  Models, data, and codes for the paper: MetaAligner: Towards Generalizable Multi-Objective Alignment of Language Models
  ☆19Updated 8 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆25Updated 5 months ago
• ChnQ / TracingLLM
  ☆26Updated last year
• sail-sg / ActivePRM
  ☆15Updated last month
• 2003pro / ScaleBiO
  This is the official implementation of ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
  ☆19Updated 10 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆44Updated 10 months ago
• ShuheSH / A-Survey-of-the-Reasoning-Abilities-of-LLMs
  ☆22Updated 3 months ago
• PorUna-byte / PAR
  ☆14Updated 3 months ago
• uw-nsl / safechain
  SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities
  ☆15Updated 2 months ago
• YJiangcm / LTE
  [ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing
  ☆36Updated 9 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆24Updated last month
• thu-ml / Noise-Contrastive-Alignment
  Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)
  ☆53Updated 6 months ago
• cliang1453 / task-aware-distillation
  Less is More: Task-aware Layer-wise Distillation for Language Model Compression (ICML2023)
  ☆35Updated last year
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆47Updated 2 months ago
• THU-KEG / AdaptThink
  ☆89Updated last week
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆61Updated 5 months ago
• mathllm / Step-Controlled_DPO
  ☆22Updated 10 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆31Updated 8 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆84Updated 7 months ago
• Alsace08 / OOD-Math-Reasoning
  [NeurIPS 2024] Code and Data Repo for Paper "Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning"
  ☆26Updated last year
• UCSB-NLP-Chang / ThinkPrune
  ☆28Updated last month
• Trustworthy-ML-Lab / ThinkEdit
  An effective weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study uncovering how reasoning length…
  ☆12Updated 3 weeks ago
• SophieZheng998 / ALI-Agent
  Official implementation for "ALI-Agent: Assessing LLMs'Alignment with Human Values via Agent-based Evaluation"
  ☆17Updated 3 weeks ago
• general-preference / general-preference-model
  Official implementation of ICML 2025 paper "Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment" (https:…
  ☆24Updated last month