eric-mitchell / direct-preference-optimization
Reference implementation for DPO (Direct Preference Optimization)
☆2,323Updated 5 months ago
Alternatives and similar repositories for direct-preference-optimization:
Users that are interested in direct-preference-optimization are comparing it to the libraries listed below
- An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)☆3,761Updated this week
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆785Updated 2 weeks ago
- A modular RL library to fine-tune language models to human preferences☆2,253Updated 10 months ago
- Secrets of RLHF in Large Language Models Part I: PPO☆1,320Updated 10 months ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆800Updated 2 months ago
- Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback☆1,394Updated 7 months ago
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆1,824Updated last year
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,425Updated 10 months ago
- A library for advanced large language model reasoning☆1,659Updated this week
- O1 Replication Journey: A Strategic Progress Report – Part I☆1,861Updated this week
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆758Updated last year
- Paper List for In-context Learning 🌷☆827Updated 3 months ago
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,108Updated 10 months ago
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)☆908Updated last month
- Aligning Large Language Models with Human: A Survey☆709Updated last year
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,609Updated 3 weeks ago
- A bibliography and survey of the papers surrounding o1☆1,042Updated 2 months ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,667Updated last year
- OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models☆1,448Updated 3 weeks ago
- Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09…☆2,015Updated this week
- [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.☆2,033Updated 2 weeks ago
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,358Updated 9 months ago
- ☆2,289Updated this week
- Recipes to train reward model for RLHF.☆1,084Updated last month
- Must-read Papers on Knowledge Editing for Large Language Models.☆986Updated 3 weeks ago
- Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads☆2,371Updated 6 months ago
- This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicit…☆732Updated 2 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆521Updated 2 weeks ago
- The official implementation of Self-Play Fine-Tuning (SPIN)☆1,099Updated 8 months ago
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,179Updated 3 months ago