RLHFlow / Online-RLHFLinks
A recipe for online RLHF and online iterative DPO.
☆514Updated 5 months ago
Alternatives and similar repositories for Online-RLHF
Users that are interested in Online-RLHF are comparing it to the libraries listed below
Sorting:
- Recipes to train reward model for RLHF.☆1,356Updated last month
- RewardBench: the first evaluation tool for reward models.☆590Updated this week
- The official implementation of Self-Play Preference Optimization (SPPO)☆563Updated 4 months ago
- verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in…☆232Updated this week
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆631Updated 4 months ago
- ☆195Updated 3 weeks ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆896Updated 3 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆245Updated last month
- A large-scale, fine-grained, diverse preference dataset (and models).☆340Updated last year
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆450Updated 7 months ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆314Updated 9 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆432Updated last year
- ☆283Updated 10 months ago
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆258Updated 2 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆239Updated last month
- A series of technical report on Slow Thinking with LLM☆679Updated last week
- ☆293Updated this week
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆368Updated 4 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆851Updated this week
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆374Updated 5 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆220Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆554Updated 5 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆213Updated 3 weeks ago
- ☆731Updated last month
- ☆330Updated 3 months ago
- ☆538Updated 5 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆219Updated 3 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆328Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆461Updated last year
- ☆201Updated 3 months ago