hkproj / rlhf-ppoLinks
Notes and commented code for RLHF (PPO)
☆121Updated last year
Alternatives and similar repositories for rlhf-ppo
Users that are interested in rlhf-ppo are comparing it to the libraries listed below
Sorting:
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆70Updated 9 months ago
- Minimal hackable GRPO implementation☆315Updated 11 months ago
- ☆100Updated last year
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆271Updated 3 months ago
- Direct Preference Optimization from scratch in PyTorch☆123Updated 9 months ago
- ☆405Updated last year
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆140Updated 8 months ago
- minimal GRPO implementation from scratch☆102Updated 10 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆614Updated last week
- LLaMA 2 implemented from scratch in PyTorch☆365Updated 2 years ago
- ☆329Updated 7 months ago
- ☆82Updated last year
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)☆218Updated 2 years ago
- Survey of Small Language Models from Penn State, ...☆238Updated 2 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆222Updated 5 months ago
- ☆327Updated 7 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆271Updated last year
- ☆107Updated 7 months ago
- ☆94Updated 5 months ago
- Tina: Tiny Reasoning Models via LoRA☆314Updated 3 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆366Updated last year
- ☆130Updated last year
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆282Updated 3 months ago
- ☆160Updated last year
- ☆255Updated 5 months ago
- A curated collection of LLM reasoning and planning resources, including key papers, limitations, benchmarks, and additional learning mate…☆306Updated 10 months ago
- An extension of the nanoGPT repository for training small MOE models.☆225Updated 10 months ago
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆150Updated last year
- A project to improve skills of large language models☆756Updated this week
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆257Updated 8 months ago