Alternatives and similar repositories for GRPO

Users that are interested in GRPO are comparing it to the libraries listed below

• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆101Updated 5 months ago
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆68Updated 9 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 11 months ago
• thu-coai / SPaR
  ☆46Updated 7 months ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆112Updated 11 months ago
• jwliao-ai / MARFT
  ☆75Updated 2 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 11 months ago
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆172Updated last month
• jwhj / OREO
  ☆117Updated 11 months ago
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆58Updated last year
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆119Updated 7 months ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆43Updated 10 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆140Updated 8 months ago
• mathllm / MathCoder2
  ☆71Updated last year
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆114Updated last year
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆113Updated 5 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year
• Infini-AI-Lab / S2FT
  ☆19Updated last year
• subconscious-systems / subconscious
  ☆62Updated this week
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆63Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• LAMDASZ-ML / Self-Backtracking
  ☆50Updated 10 months ago
• Interplay-LM-Reasoning / Interplay-LM-Reasoning
  ☆118Updated last month
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆70Updated 9 months ago
• shenao-zhang / BARL
  Bayes-Adaptive RL for LLM Reasoning
  ☆43Updated 7 months ago
• bradhilton / o1-chain-of-thought
  o1 Chain of Thought Examples
  ☆33Updated last year
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆180Updated 6 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆46Updated 10 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• mukhal / ThinkPRM
  Process Reward Models That Think
  ☆70Updated last month