thomfoster / minRLHFLinks
A (somewhat) minimal library for finetuning language models with PPO on human feedback.
☆85Updated 2 years ago
Alternatives and similar repositories for minRLHF
Users that are interested in minRLHF are comparing it to the libraries listed below
Sorting:
- ☆96Updated 2 years ago
- RLHF implementation details of OAI's 2019 codebase☆187Updated last year
- ☆142Updated 7 months ago
- ☆159Updated 2 years ago
- A repository for transformer critique learning and generation☆90Updated last year
- ☆95Updated 11 months ago
- Self-Alignment with Principle-Following Reward Models☆161Updated last month
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆208Updated last year
- Simple next-token-prediction for RLHF☆227Updated last year
- A minimum example of aligning language models with RLHF similar to ChatGPT☆220Updated last year
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆191Updated 10 months ago
- Async pipelined version of Verl☆100Updated 2 months ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆182Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year
- ☆97Updated 11 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆76Updated last year
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆54Updated last year
- ☆105Updated 2 years ago
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆141Updated 4 months ago
- A toolkit for scaling law research ⚖☆49Updated 4 months ago
- ☆101Updated 8 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆108Updated this week
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆203Updated last year
- ☆123Updated 8 months ago
- DSIR large-scale data selection framework for language model training☆251Updated last year
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆171Updated 2 years ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆179Updated 2 months ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆57Updated last month
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆105Updated last month