RLHFlow / Online-RLHFLinks
A recipe for online RLHF and online iterative DPO.
☆538Updated 11 months ago
Alternatives and similar repositories for Online-RLHF
Users that are interested in Online-RLHF are comparing it to the libraries listed below
Sorting:
- Recipes to train reward model for RLHF.☆1,488Updated 8 months ago
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆455Updated last year
- ☆254Updated 7 months ago
- RewardBench: the first evaluation tool for reward models.☆670Updated 6 months ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆326Updated last year
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆278Updated 9 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆583Updated 11 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆229Updated 9 months ago
- ☆340Updated 6 months ago
- ☆328Updated 6 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆283Updated last year
- Controllable Text Generation for Large Language Models: A Survey☆197Updated last year
- A large-scale, fine-grained, diverse preference dataset (and models).☆357Updated last year
- Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)☆199Updated 2 years ago
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆389Updated 11 months ago
- ☆213Updated 10 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆263Updated 8 months ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆934Updated 10 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆509Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆269Updated last year
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆686Updated 11 months ago
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆507Updated 4 months ago
- ☆318Updated last year
- Secrets of RLHF in Large Language Models Part I: PPO☆1,408Updated last year
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆249Updated 8 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆258Updated 7 months ago
- A series of technical report on Slow Thinking with LLM☆753Updated 4 months ago
- Benchmarking LLMs via Uncertainty Quantification☆255Updated last year
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆269Updated last year
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆350Updated 2 years ago