Alternatives and similar repositories for GRPO-Zero

Users that are interested in GRPO-Zero are comparing it to the libraries listed below

• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆1,939Updated 4 months ago
• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆1,396Updated this week
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆4,116Updated this week
• huggingface / nanoVLM
  The simplest, fastest repository for training/finetuning small-sized VLMs.
  ☆4,494Updated 2 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆576Updated 3 months ago
• KellerJordan / Muon
  Muon is an optimizer for hidden layers in neural networks
  ☆2,179Updated last month
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,186Updated 4 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,123Updated 7 months ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,449Updated 5 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,397Updated 5 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,411Updated last month
• facebookresearch / blt
  Code for BLT research paper
  ☆2,024Updated 2 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,304Updated 3 weeks ago
• SonyResearch / micro_diffusion
  Official repository for our work on micro-budget training of large-scale diffusion models.
  ☆1,547Updated last year
• NVIDIA-NeMo / RL
  Scalable toolkit for efficient model reinforcement
  ☆1,210Updated this week
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models
  ☆4,209Updated this week
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆2,222Updated last year
• PrimeIntellect-ai / verifiers
  Our library for RL environments + evals
  ☆3,730Updated this week
• THUDM / slime
  slime is an LLM post-training framework for RL Scaling.
  ☆3,224Updated this week
• hkust-nlp / simpleRL-reason
  Simple RL training for reasoning
  ☆3,826Updated 3 weeks ago
• thinking-machines-lab / batch_invariant_ops
  ☆945Updated 2 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,216Updated last year
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,061Updated 5 months ago
• rllm-org / rllm
  Democratizing Reinforcement Learning for LLMs
  ☆4,965Updated this week
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆4,947Updated this week
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆562Updated 2 months ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆859Updated 2 weeks ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆945Updated 3 months ago
• huggingface / smollm
  Everything about the SmolLM and SmolVLM family of models
  ☆3,539Updated last month
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,702Updated 8 months ago