thomfoster / minRLHFLinks
A (somewhat) minimal library for finetuning language models with PPO on human feedback.
☆86Updated 2 years ago
Alternatives and similar repositories for minRLHF
Users that are interested in minRLHF are comparing it to the libraries listed below
Sorting:
- ☆96Updated 2 years ago
- ☆148Updated 9 months ago
- RLHF implementation details of OAI's 2019 codebase☆189Updated last year
- Code accompanying the paper Pretraining Language Models with Human Preferences☆181Updated last year
- Simple next-token-prediction for RLHF☆227Updated last year
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆209Updated 2 years ago
- ☆159Updated 2 years ago
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆172Updated 2 years ago
- Scaling Data-Constrained Language Models☆339Updated last month
- Self-Alignment with Principle-Following Reward Models☆163Updated 3 months ago
- RL algorithm: Advantage induced policy alignment☆65Updated 2 years ago
- DSIR large-scale data selection framework for language model training☆258Updated last year
- Recurrent Memory Transformer☆150Updated 2 years ago
- A repository for transformer critique learning and generation☆90Updated last year
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆112Updated last week
- [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks☆54Updated 2 years ago
- A minimum example of aligning language models with RLHF similar to ChatGPT☆221Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆219Updated 2 years ago
- ☆241Updated 2 years ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆60Updated 3 months ago
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆76Updated last year
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆56Updated last year
- ☆104Updated last month
- ☆100Updated last year
- Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024☆137Updated 6 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆206Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆199Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆136Updated last year
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆178Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year