RLHFlow / Online-RLHF
A recipe for online RLHF and online iterative DPO.
☆508Updated 4 months ago
Alternatives and similar repositories for Online-RLHF:
Users that are interested in Online-RLHF are comparing it to the libraries listed below
- Recipes to train reward model for RLHF.☆1,322Updated 2 weeks ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆306Updated 9 months ago
- Recipes to train the self-rewarding reasoning LLMs.☆216Updated 2 months ago
- RewardBench: the first evaluation tool for reward models.☆562Updated this week
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆891Updated 2 months ago
- The official implementation of Self-Play Preference Optimization (SPPO)☆548Updated 3 months ago
- Codebase for Iterative DPO Using Rule-based Rewards☆243Updated last month
- ☆155Updated 3 weeks ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆619Updated 3 months ago
- A series of technical report on Slow Thinking with LLM☆659Updated 3 weeks ago
- ☆328Updated 3 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆442Updated 6 months ago
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆257Updated last month
- ☆287Updated last month
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆433Updated last year
- ☆526Updated 4 months ago
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆357Updated 4 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆235Updated 3 weeks ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆459Updated last year
- ☆279Updated 9 months ago
- ☆683Updated last week
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆838Updated this week
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆364Updated 3 months ago
- Large Reasoning Models☆804Updated 5 months ago
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆697Updated last month
- ☆194Updated 2 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆337Updated last year
- [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆607Updated last year
- ☆928Updated 3 months ago
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)☆205Updated 2 years ago