hkproj / rlhf-ppoLinks
Notes and commented code for RLHF (PPO)
☆111Updated last year
Alternatives and similar repositories for rlhf-ppo
Users that are interested in rlhf-ppo are comparing it to the libraries listed below
Sorting:
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆66Updated 6 months ago
- Minimal hackable GRPO implementation☆294Updated 8 months ago
- ☆96Updated last year
- Direct Preference Optimization from scratch in PyTorch☆116Updated 6 months ago
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆266Updated last week
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆121Updated 5 months ago
- ☆380Updated 10 months ago
- LLaMA 2 implemented from scratch in PyTorch☆358Updated 2 years ago
- minimal GRPO implementation from scratch☆98Updated 7 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆136Updated 8 months ago
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)☆214Updated 2 years ago
- Survey of Small Language Models from Penn State, ...☆207Updated 2 weeks ago
- ☆323Updated 4 months ago
- ☆130Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆219Updated 3 months ago
- ☆300Updated 5 months ago
- A project to improve skills of large language models☆587Updated last week
- Official repository for ORPO☆463Updated last year
- Tina: Tiny Reasoning Models via LoRA☆299Updated last month
- ☆86Updated 4 months ago
- ☆218Updated 2 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆362Updated last year
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆539Updated this week
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆112Updated 2 months ago
- Large Reasoning Models☆805Updated 10 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆258Updated 5 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆259Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆202Updated 7 months ago
- ☆211Updated 8 months ago
- ☆447Updated 3 months ago