Alternatives and similar repositories for rlhf-ppo

Users that are interested in rlhf-ppo are comparing it to the libraries listed below

• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆53Updated 2 months ago
• neubig / minllama-assignment
  ☆87Updated 8 months ago
• 0xallam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆92Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 2 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆105Updated 3 weeks ago
• GAIR-NLP / ToRL
  ☆198Updated last week
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆232Updated 4 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆182Updated this week
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆136Updated 5 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆128Updated 2 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆122Updated last year
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆231Updated 3 weeks ago
• vwxyzjn / summarize_from_feedback_details
  ☆140Updated 6 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆68Updated last year
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆213Updated 3 weeks ago
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆129Updated 10 months ago
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆314Updated 9 months ago
• mengdi-li / awesome-RLAIF
  A continually updated list of literature on Reinforcement Learning from AI Feedback (RLAIF)
  ☆170Updated 4 months ago
• BrendanGraham14 / mcts-llm
  ☆124Updated 11 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆97Updated 9 months ago
• jwhj / OREO
  ☆113Updated 4 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆102Updated last year
• GAIR-NLP / LIMR
  ☆201Updated 3 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆147Updated 2 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆151Updated last month
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆177Updated last month
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆147Updated 2 weeks ago
• ypwang61 / One-Shot-RLVR
  official repository for “Reinforcement Learning for Reasoning in Large Language Models with One Training Example”
  ☆257Updated this week
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆102Updated 5 months ago
• GAIR-NLP / ProX
  [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
  ☆248Updated 2 weeks ago