Alternatives and similar repositories for DPO:

Users that are interested in DPO are comparing it to the libraries listed below

• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆32Updated 4 months ago
• Asap7772 / understanding-rlhf
  ☆25Updated 10 months ago
• ZhaolinGao / REBEL
  ☆28Updated 2 months ago
• facebookresearch / oni
  Learn online intrinsic rewards from LLM feedback
  ☆34Updated 2 months ago
• berlino / seq_icl
  ☆51Updated 9 months ago
• katiekang1998 / reasoning_generalization
  ☆28Updated last month
• cassidylaidlaw / orpo
  ☆13Updated 3 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆15Updated last month
• gregorbachmann / Next-Token-Failures
  ☆80Updated 11 months ago
• EleutherAI / w2s
  ☆21Updated 5 months ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆15Updated 2 weeks ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 2 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆31Updated 3 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆40Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 11 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• google-deepmind / asyncdiloco
  ☆42Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• jiahai-feng / binding-iclr
  ☆12Updated 11 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Updated 8 months ago
• formll / resolving-scaling-law-discrepancies
  ☆17Updated 7 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 9 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆61Updated 9 months ago
• RobertCsordas / moeut
  ☆73Updated 6 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆38Updated last month
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆41Updated 5 months ago