Alternatives and similar repositories for direct-preference-optimization:

Users that are interested in direct-preference-optimization are comparing it to the libraries listed below

• allenai / RL4LMs
  A modular RL library to fine-tune language models to human preferences
  ☆2,288Updated last year
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆816Updated last week
• OpenRLHF / OpenRLHF
  An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)
  ☆5,707Updated this week
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆843Updated last month
• PKU-Alignment / safe-rlhf
  Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
  ☆1,427Updated 9 months ago
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,331Updated last year
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,685Updated 2 months ago
• openreasoner / openr
  OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models
  ☆1,718Updated 2 months ago
• dqxiu / ICL_PaperList
  Paper List for In-context Learning 🌷
  ☆849Updated 5 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,180Updated 4 months ago
• RLHFlow / RLHF-Reward-Modeling
  Recipes to train reward model for RLHF.
  ☆1,242Updated last month
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,703Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,138Updated last year
• GAIR-NLP / O1-Journey
  O1 Replication Journey
  ☆1,972Updated 2 months ago
• philschmid / deep-learning-pytorch-huggingface
  ☆1,079Updated 3 weeks ago
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,475Updated last year
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆2,804Updated this week
• FasterDecoding / Medusa
  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
  ☆2,460Updated 8 months ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆765Updated last year
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,130Updated 10 months ago
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆799Updated 10 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,056Updated 3 months ago
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,215Updated 2 weeks ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,520Updated 4 months ago
• Xnhyacinth / Awesome-LLM-Long-Context-Modeling
  📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
  ☆1,326Updated last week
• HillZhang1999 / llm-hallucination-survey
  Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …
  ☆994Updated 3 months ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆931Updated 3 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,684Updated this week
• opendilab / awesome-RLHF
  A curated list of reinforcement learning with human feedback resources (continually updated)
  ☆3,801Updated last month