Alternatives and similar repositories for GRPO

Users that are interested in GRPO are comparing it to the libraries listed below

• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆97Updated last month
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆110Updated last year
• jwliao-ai / MARFT
  MARFT stands for Multi-Agent Reinforcement Fine-Tuning. This repository implements an LLM-based multi-agent reinforcement fine-tuning fra…
  ☆62Updated last month
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 7 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆150Updated 10 months ago
• thu-coai / SPaR
  ☆46Updated 3 months ago
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• jwhj / OREO
  ☆116Updated 8 months ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆111Updated 8 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆105Updated 3 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆61Updated 7 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆120Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆106Updated 2 months ago
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆54Updated 10 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆48Updated 7 months ago
• shenao-zhang / BARL
  Bayes-Adaptive RL for LLM Reasoning
  ☆39Updated 3 months ago
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆64Updated 5 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆105Updated last month
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆64Updated last year
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• convergence-ai / lm2
  Official repo of paper LM2
  ☆44Updated 7 months ago
• Gabesarch / ICAL
  ☆48Updated 4 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆113Updated last week
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆80Updated 6 months ago
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆127Updated 11 months ago
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] ReasonFlux-Coder: Open-Source LLM Coders with Co-Evolving Reinforcement Learning
  ☆117Updated last week
• McGill-NLP / agent-reward-bench
  AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  ☆37Updated last month
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 5 months ago
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆144Updated last month
• amazon-science / PAE
  ☆63Updated 6 months ago