Alternatives and similar repositories for rlhf-ppo

Users that are interested in rlhf-ppo are comparing it to the libraries listed below

• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆300Updated 9 months ago
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆66Updated 7 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆125Updated 6 months ago
• 0xallam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆120Updated 7 months ago
• neubig / minllama-assignment
  ☆99Updated last year
• stanford-cs336 / spring2024-lectures
  ☆393Updated 10 months ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆269Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆99Updated 8 months ago
• eddycmu / demystify-long-cot
  ☆326Updated 5 months ago
• SiliangZeng / Multi-Turn-RL-Agent
  ☆94Updated 5 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆608Updated last week
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆304Updated last month
• stanford-cs336 / assignment5-alignment
  ☆71Updated 3 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆222Updated 3 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆564Updated 2 weeks ago
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆807Updated 11 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆258Updated 6 months ago
• GAIR-NLP / ToRL
  ☆309Updated 5 months ago
• ReTool-RL / ReTool
  ☆231Updated 3 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆136Updated 8 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆144Updated 9 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆358Updated 2 years ago
• hkproj / dpo-notes
  Notes on Direct Preference Optimization
  ☆23Updated last year
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆284Updated last year
• ypwang61 / One-Shot-RLVR
  [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  ☆375Updated last month
• vwxyzjn / summarize_from_feedback_details
  ☆155Updated 11 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆365Updated last year
• zwhe99 / DeepMath
  A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning
  ☆269Updated last month
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆249Updated 6 months ago
• TsinghuaC3I / MARTI
  A Framework for LLM-based Multi-Agent Reinforced Training and Inference
  ☆341Updated this week