Alternatives and similar repositories for rlhf-ppo

Users that are interested in rlhf-ppo are comparing it to the libraries listed below

• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆71Updated 10 months ago
• 0xallam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆126Updated 10 months ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆273Updated 3 months ago
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆323Updated last year
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆143Updated 9 months ago
• neubig / minllama-assignment
  ☆100Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 10 months ago
• shangshang-wang / Tina
  [ICLR 2026] Tina: Tiny Reasoning Models via LoRA
  ☆319Updated 4 months ago
• stanford-cs336 / assignment5-alignment
  ☆105Updated 6 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆366Updated 2 years ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆236Updated 11 months ago
• SiliangZeng / Multi-Turn-RL-Agent
  ☆113Updated 8 months ago
• stanford-cs336 / spring2024-lectures
  ☆413Updated last year
• eddycmu / demystify-long-cot
  ☆330Updated 8 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆162Updated last year
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆273Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆94Updated last year
• BrendanGraham14 / mcts-llm
  ☆130Updated last year
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆116Updated 6 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆627Updated 2 weeks ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆261Updated 8 months ago
• FairyFali / SLMs-Survey
  Survey of Small Language Models from Penn State, ...
  ☆242Updated 3 months ago
• ypwang61 / One-Shot-RLVR
  [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  ☆408Updated 2 months ago
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆220Updated 2 years ago
• sunblaze-ucb / Intuitor
  [ICLR 2026] Learning to Reason without External Rewards
  ☆391Updated 2 weeks ago
• GAIR-NLP / ToRL
  ☆333Updated 8 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• mathllm / MathCoder
  [MathCoder, MathCoder-VL] Family of LLMs/LMMs for mathematical reasoning.
  ☆339Updated 3 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆593Updated 4 months ago