Alternatives and similar repositories for GRPO

Users that are interested in GRPO are comparing it to the libraries listed below

• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆101Updated 6 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆115Updated 2 years ago
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆181Updated 2 months ago
• jwliao-ai / MARFT
  ☆76Updated 3 months ago
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆120Updated last week
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆59Updated last year
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆68Updated 9 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 11 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆143Updated 9 months ago
• thu-coai / SPaR
  ☆46Updated 7 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year
• jwhj / OREO
  ☆117Updated last year
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆113Updated last year
• LAMDASZ-ML / Self-Backtracking
  ☆52Updated 11 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆114Updated last week
• shenao-zhang / BARL
  Bayes-Adaptive RL for LLM Reasoning
  ☆45Updated 8 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated last year
• sanyalsunny111 / LLM-Inheritune
  [TMLR 2026] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
  ☆122Updated last year
• CLAIRE-Labo / EvoTune
  Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
  ☆130Updated 2 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆87Updated 10 months ago
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning
  ☆149Updated 4 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆46Updated 11 months ago
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• clinicalml / co-llm
  Co-LLM: Learning to Decode Collaboratively with Multiple Language Models
  ☆126Updated last year
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆116Updated 6 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆63Updated last year
• mukhal / ThinkPRM
  Process Reward Models That Think
  ☆78Updated 2 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• fangyuan-ksgk / Evolutionary-Model-Merge
  Unofficial Implementation of Evolutionary Model Merging
  ☆41Updated last year