Alternatives and similar repositories for orpo

Users that are interested in orpo are comparing it to the libraries listed below

• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆20Updated last year
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 5 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated 2 years ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆29Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆16Updated 11 months ago
• tianjunz / TEMPERA
  ☆44Updated 2 years ago
• jiahai-feng / binding-iclr
  ☆14Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 2 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 7 months ago
• lingo-mit / lm-truthfulness
  ☆17Updated last year
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆30Updated 5 months ago
• gregorbachmann / Next-Token-Failures
  ☆87Updated last year
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆16Updated 2 years ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆112Updated 3 months ago
• allenbai01 / transformers-as-statisticians
  ☆32Updated 2 years ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 10 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆33Updated 2 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆44Updated last year
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆64Updated 3 months ago
• wenzhe-li / Self-MoA
  ☆17Updated 5 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 3 months ago
• r-three / mats
  ☆31Updated last year
• EleutherAI / w2s
  ☆23Updated 9 months ago
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆58Updated last year
• katiekang1998 / reasoning_generalization
  ☆33Updated 6 months ago
• JonasGeiping / dataaugs
  ☆18Updated 2 years ago