Alternatives and similar repositories for nanoGRPO:

Users that are interested in nanoGRPO are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆87Updated last month
• jwhj / OREO
  ☆109Updated 3 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with Reinforcement Learning (RL) on GSM8K, inspired by RLVR and Deepseek R1. This repositor…
  ☆84Updated 3 months ago
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆141Updated 2 weeks ago
• vwxyzjn / summarize_from_feedback_details
  ☆138Updated 5 months ago
• architsharma97 / dpo-rlaif
  ☆97Updated 10 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆85Updated last month
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆138Updated 2 months ago
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆143Updated 7 months ago
• ScalingIntelligence / large_language_monkeys
  ☆92Updated 7 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 3 months ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆215Updated this week
• rsshyam / GRPO
  ☆57Updated 9 months ago
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆28Updated 2 months ago
• THU-KEG / Agentic-Reward-Modeling
  Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆90Updated 2 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 2 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆128Updated 2 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆100Updated this week
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆53Updated 9 months ago
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆158Updated 10 months ago
• RobertCsordas / moeut
  ☆78Updated 8 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆226Updated this week
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆217Updated 3 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆51Updated 2 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆94Updated last month
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆189Updated last week
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆91Updated 2 weeks ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆64Updated 11 months ago