Alternatives and similar repositories for orpo:

Users that are interested in orpo are comparing it to the libraries listed below

• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆18Updated last month
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 10 months ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 8 months ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 6 months ago
• Asap7772 / understanding-rlhf
  ☆26Updated 11 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated 2 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 10 months ago
• ctlllll / reward_collapse
  ☆27Updated last year
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆39Updated 3 months ago
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆25Updated last year
• EleutherAI / w2s
  ☆22Updated 6 months ago
• yikangshen / megablocks
  ☆18Updated 10 months ago
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 3 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆41Updated last year
• shadowkiller33 / Contrast-Instruction
  ☆19Updated last year
• Cornell-RL / drpo
  Dateset Reset Policy Optimization
  ☆30Updated 11 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆43Updated 8 months ago
• prajjwal1 / rl_paradigm
  ☆16Updated last year
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆16Updated 7 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆16Updated 3 weeks ago
• Joshuaclymer / GameBench
  ☆16Updated 9 months ago
• weigq / openview_quicklook
  ☆32Updated 3 weeks ago
• katiekang1998 / reasoning_generalization
  ☆31Updated 2 months ago
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆56Updated last year
• yale-nlp / refdpo
  ☆16Updated 8 months ago
• belindal / LaMPP
  Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action
  ☆36Updated 2 years ago
• deeplearning-wisc / args
  ☆37Updated last year
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 6 months ago