vwxyzjn / lm-human-preference-details
RLHF implementation details of OAI's 2019 codebase
☆186Updated last year
Alternatives and similar repositories for lm-human-preference-details:
Users that are interested in lm-human-preference-details are comparing it to the libraries listed below
- ☆137Updated 5 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆151Updated 5 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆256Updated 7 months ago
- A (somewhat) minimal library for finetuning language models with PPO on human feedback.☆85Updated 2 years ago
- Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)☆181Updated last year
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆264Updated 10 months ago
- ☆326Updated 2 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆321Updated last year
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆162Updated last week
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆303Updated 8 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆336Updated last year
- ☆97Updated last year
- ☆274Updated 3 months ago
- ☆149Updated 4 months ago
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆136Updated 2 months ago
- RewardBench: the first evaluation tool for reward models.☆555Updated last month
- Simple next-token-prediction for RLHF☆225Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆203Updated 11 months ago
- ☆187Updated 2 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆175Updated last month
- Repo of paper "Free Process Rewards without Process Labels"☆143Updated last month
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆120Updated 7 months ago
- ☆159Updated 2 years ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆281Updated 3 months ago
- Rectified Rotary Position Embeddings☆366Updated 11 months ago
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆122Updated 9 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.☆325Updated this week
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆53Updated 10 months ago
- Direct Preference Optimization from scratch in PyTorch☆90Updated 2 weeks ago
- A project to improve skills of large language models☆295Updated this week