thomfoster / minRLHF
A (somewhat) minimal library for finetuning language models with PPO on human feedback.
☆85Updated 2 years ago
Alternatives and similar repositories for minRLHF:
Users that are interested in minRLHF are comparing it to the libraries listed below
- ☆97Updated last year
- RLHF implementation details of OAI's 2019 codebase☆186Updated last year
- ☆138Updated 5 months ago
- A repository for transformer critique learning and generation☆90Updated last year
- ☆159Updated 2 years ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- ☆97Updated 10 months ago
- Self-Alignment with Principle-Following Reward Models☆161Updated this week
- Simple next-token-prediction for RLHF☆225Updated last year
- ☆98Updated 7 months ago
- DSIR large-scale data selection framework for language model training☆246Updated last year
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆155Updated 5 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆108Updated this week
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆76Updated last year
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆205Updated 11 months ago
- Critique-out-Loud Reward Models☆64Updated 6 months ago
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆173Updated 2 years ago
- A toolkit for scaling law research ⚖☆49Updated 3 months ago
- ☆257Updated last year
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year
- Open Source WizardCoder Dataset☆158Updated last year
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆207Updated last year
- ☆275Updated 4 months ago
- ☆109Updated 3 months ago
- ☆120Updated 7 months ago
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆77Updated last year
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆49Updated last week
- Scaling Data-Constrained Language Models☆334Updated 7 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆154Updated 10 months ago