Alternatives and similar repositories for direct-preference-optimization

Users that are interested in direct-preference-optimization are comparing it to the libraries listed below

• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,376Updated last year
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆944Updated 11 months ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆903Updated 4 months ago
• PKU-Alignment / safe-rlhf
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,582Updated 2 months ago
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,940Updated 5 months ago
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆2,087Updated 2 years ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,227Updated last year
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,417Updated last year
• GAIR-NLP / O1-Journey
  O1 Replication Journey
  ☆2,001Updated last year
• openreasoner / openr
  OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models
  ☆1,833Updated last year
• OpenRLHF / OpenRLHF
  An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)
  ☆8,949Updated this week
• FranxYao / chain-of-thought-hub
  Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
  ☆2,769Updated last year
• openai / lm-human-preferences
  Code for the paper Fine-Tuning Language Models from Human Preferences
  ☆1,376Updated 2 years ago
• hkust-nlp / simpleRL-reason
  Simple RL training for reasoning
  ☆3,829Updated last month
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆3,562Updated this week
• RLHFlow / RLHF-Reward-Modeling
  Recipes to train reward model for RLHF.
  ☆1,512Updated 9 months ago
• CarperAI / trlx
  A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆4,741Updated 2 years ago
• dqxiu / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆874Updated last year
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,654Updated last year
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,231Updated last year
• hendrycks / test
  Measuring Massive Multitask Language Understanding | ICLR 2021
  ☆1,546Updated 2 years ago
• maitrix-org / llm-reasoners
  A library for advanced large language model reasoning
  ☆2,328Updated 7 months ago
• Open-Reasoner-Zero / Open-Reasoner-Zero
  Official Repo for Open-Reasoner-Zero
  ☆2,086Updated 8 months ago
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,811Updated 7 months ago
• hiyouga / EasyR1
  EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
  ☆4,530Updated last week
• opendilab / awesome-RLHF
  A curated list of reinforcement learning with human feedback resources (continually updated)
  ☆4,280Updated last month
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,715Updated 8 months ago
• philschmid / deep-learning-pytorch-huggingface
  ☆1,345Updated 11 months ago
• Xnhyacinth / Awesome-LLM-Long-Context-Modeling
  📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
  ☆1,895Updated 2 weeks ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,213Updated last year