thomfoster / minRLHFLinks
A (somewhat) minimal library for finetuning language models with PPO on human feedback.
☆85Updated 2 years ago
Alternatives and similar repositories for minRLHF
Users that are interested in minRLHF are comparing it to the libraries listed below
Sorting:
- ☆96Updated 2 years ago
- ☆147Updated 8 months ago
- RLHF implementation details of OAI's 2019 codebase☆187Updated last year
- Code accompanying the paper Pretraining Language Models with Human Preferences☆182Updated last year
- Simple next-token-prediction for RLHF☆227Updated last year
- ☆159Updated 2 years ago
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆208Updated 2 years ago
- A repository for transformer critique learning and generation☆90Updated last year
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆171Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆162Updated 2 months ago
- ☆99Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆219Updated last year
- Scaling Data-Constrained Language Models☆338Updated last month
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆56Updated last year
- DSIR large-scale data selection framework for language model training☆257Updated last year
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆112Updated last week
- A minimum example of aligning language models with RLHF similar to ChatGPT☆220Updated last year
- RL algorithm: Advantage induced policy alignment☆65Updated last year
- [NeurIPS 2023] Learning Transformer Programs☆162Updated last year
- Recurrent Memory Transformer☆150Updated last year
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆59Updated 3 months ago
- ☆239Updated 2 years ago
- Awesome Reinforcement Learning from Human Feedback, the secret behind ChatGPT XD☆23Updated 2 years ago
- ☆103Updated 2 weeks ago
- Pre-training code for Amber 7B LLM☆167Updated last year
- Reasoning with Language Model is Planning with World Model☆168Updated last year
- A large-scale, fine-grained, diverse preference dataset (and models).☆345Updated last year
- ☆99Updated last year
- ☆124Updated 10 months ago
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆76Updated last year