RLHFlow / Online-RLHF
A recipe for online RLHF and online iterative DPO.
☆494Updated 2 months ago
Alternatives and similar repositories for Online-RLHF:
Users that are interested in Online-RLHF are comparing it to the libraries listed below
- Recipes to train reward model for RLHF.☆1,237Updated last month
- The official implementation of Self-Play Preference Optimization (SPPO)☆498Updated last month
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models☆418Updated last year
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆244Updated last week
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆301Updated 2 months ago
- RewardBench: the first evaluation tool for reward models.☆521Updated 2 weeks ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆293Updated 7 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆589Updated last month
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆841Updated 3 weeks ago
- ☆326Updated last month
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆416Updated 4 months ago
- Controllable Text Generation for Large Language Models: A Survey☆162Updated 6 months ago
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆354Updated last month
- ☆309Updated 5 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆245Updated 6 months ago
- Secrets of RLHF in Large Language Models Part I: PPO☆1,327Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆536Updated 3 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆331Updated last year
- A series of technical report on Slow Thinking with LLM☆519Updated this week
- ☆261Updated 7 months ago
- RLHF implementation details of OAI's 2019 codebase☆183Updated last year
- ☆490Updated 2 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆184Updated 10 months ago
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆348Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆453Updated 11 months ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆342Updated 6 months ago