Alternatives and similar repositories for orpo:

Users that are interested in orpo are comparing it to the libraries listed below

• Asap7772 / understanding-rlhf
  ☆25Updated 9 months ago
• ctlllll / reward_collapse
  ☆26Updated last year
• IdoAmos / not-from-scratch
  ☆28Updated 3 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• okarthikb / DPO
  Implementation of Direct Preference Optimization
  ☆15Updated last year
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆26Updated 4 months ago
• prajjwal1 / rl_paradigm
  ☆15Updated 11 months ago
• UW-Madison-Lee-Lab / Expressive_Power_of_LoRA
  Code for "The Expressive Power of Low-Rank Adaptation".
  ☆19Updated 9 months ago
• weigq / openview_quicklook
  ☆31Updated 10 months ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆24Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 8 months ago
• yikangshen / megablocks
  ☆18Updated 8 months ago
• EleutherAI / w2s
  ☆20Updated 4 months ago
• ZhaolinGao / REBEL
  ☆28Updated last month
• formll / resolving-scaling-law-discrepancies
  ☆16Updated 6 months ago
• Joshuaclymer / GameBench
  ☆11Updated 7 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated this week
• duykhuongnguyen / LASeR-MAB
  Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"
  ☆13Updated 3 months ago
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• allenbai01 / transformers-as-statisticians
  ☆27Updated last year
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆38Updated last month
• PAL-ML / PEARL_v1
  ☆29Updated 3 years ago
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆27Updated 6 months ago
• Kaixhin / GUDRL
  Generalised UDRL
  ☆37Updated 2 years ago
• RandallBalestriero / SplineLLM
  ☆14Updated last year
• yiqiwang8177 / Official-codebase-for-Decision-Transducer
  This is the pytorch implementation of the UAI2023 paper "A Trajectory is Worth Three Sentences: Multimodal Transformer for Offline Reinf…
  ☆11Updated last year
• jiahai-feng / binding-iclr
  ☆12Updated 10 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 11 months ago