Alternatives and similar repositories for orpo

Users that are interested in orpo are comparing it to the libraries listed below

• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆21Updated last year
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆60Updated last year
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆30Updated last year
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆45Updated last year
• ctlllll / reward_collapse
  ☆27Updated 2 years ago
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆25Updated last year
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 4 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆59Updated 11 months ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆27Updated last year
• Jiuzhouh / Uncertainty-Aware-Language-Agent
  This is the official repo for Towards Uncertainty-Aware Language Agent.
  ☆28Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 4 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated 2 years ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆35Updated last year
• gregorbachmann / Next-Token-Failures
  ☆98Updated last year
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 7 months ago
• allenbai01 / transformers-as-statisticians
  ☆33Updated 2 years ago
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆31Updated 7 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 7 months ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago
• jiahai-feng / binding-iclr
  ☆15Updated last year
• deeplearning-wisc / args
  ☆44Updated last year
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆116Updated 5 months ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 11 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 8 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated 11 months ago
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆16Updated 2 years ago
• ZhentingWang / DUMP
  ☆24Updated 3 months ago