Alternatives and similar repositories for GRPO-Zero

Users that are interested in GRPO-Zero are comparing it to the libraries listed below

• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆1,890Updated 2 months ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆3,785Updated last week
• KellerJordan / Muon
  Muon is an optimizer for hidden layers in neural networks
  ☆1,983Updated 4 months ago
• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆1,295Updated this week
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,327Updated 3 months ago
• facebookresearch / blt
  Code for BLT research paper
  ☆2,006Updated last week
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆556Updated last month
• huggingface / nanoVLM
  The simplest, fastest repository for training/finetuning small-sized VLMs.
  ☆4,229Updated 2 weeks ago
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,148Updated 2 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,354Updated 3 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,214Updated last month
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,117Updated 5 months ago
• SonyResearch / micro_diffusion
  Official repository for our work on micro-budget training of large-scale diffusion models.
  ☆1,521Updated 10 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,311Updated 2 months ago
• hkust-nlp / simpleRL-reason
  Simple RL training for reasoning
  ☆3,784Updated 3 months ago
• PrimeIntellect-ai / verifiers
  Environments for LLM Reinforcement Learning
  ☆3,475Updated this week
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,045Updated 3 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,208Updated 11 months ago
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models
  ☆3,787Updated last week
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆843Updated 3 weeks ago
• ML-GSAI / LLaDA
  Official PyTorch implementation for "Large Language Diffusion Models"
  ☆3,210Updated this week
• rllm-org / rllm
  Democratizing Reinforcement Learning for LLMs
  ☆4,699Updated this week
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆651Updated last year
• lucidrains / native-sparse-attention-pytorch
  Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
  ☆779Updated 2 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆530Updated 3 weeks ago
• mll-lab-nu / RAGEN
  RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.
  ☆2,390Updated this week
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,626Updated 6 months ago
• NVIDIA-NeMo / RL
  Scalable toolkit for efficient model reinforcement
  ☆1,009Updated this week
• lucidrains / titans-pytorch
  Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch
  ☆1,486Updated last month
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆4,675Updated this week