Alternatives and similar repositories for nanoGRPO

Users that are interested in nanoGRPO are comparing it to the libraries listed below

• SalesforceAIResearch / LaTRO
  ☆115Updated 4 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 3 months ago
• jwhj / OREO
  ☆114Updated 5 months ago
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆54Updated 10 months ago
• architsharma97 / dpo-rlaif
  ☆97Updated 11 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆93Updated 2 weeks ago
• SiliangZeng / Multi-Turn-RL-Agent
  ☆48Updated last week
• sunblaze-ucb / Intuitor
  Code for the paper: "Learning to Reason without External Rewards"
  ☆295Updated last week
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 5 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆230Updated last month
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆175Updated this week
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆159Updated 2 weeks ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆221Updated last month
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆95Updated 2 weeks ago
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆247Updated 4 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆260Updated 3 weeks ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆57Updated last month
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆101Updated 4 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆41Updated 4 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆142Updated 7 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 4 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 6 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆141Updated 2 weeks ago
• agentification / RAFA_code
  ☆142Updated last year
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆106Updated 5 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆125Updated this week
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆255Updated last week
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆29Updated 4 months ago