Alternatives and similar repositories for nanoGRPO

Users that are interested in nanoGRPO are comparing it to the libraries listed below

• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆315Updated 11 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 10 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆314Updated 3 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆181Updated 6 months ago
• SalesforceAIResearch / LaTRO
  ☆123Updated 10 months ago
• SiliangZeng / Multi-Turn-RL-Agent
  ☆107Updated 7 months ago
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆195Updated last year
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆252Updated 4 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆142Updated 10 months ago
• ZihanWang314 / CoE
  Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models
  ☆226Updated 2 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year
• VITA-Group / WeLore
  [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications
  ☆52Updated 2 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆154Updated 11 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆46Updated 11 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆68Updated 8 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆370Updated last year
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆101Updated 5 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆342Updated last month
• sunblaze-ucb / Intuitor
  Code for the paper: "Learning to Reason without External Rewards"
  ☆385Updated 6 months ago
• jwhj / OREO
  ☆117Updated 11 months ago
• rsshyam / GRPO
  ☆68Updated last year
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆82Updated last year
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆234Updated 3 months ago
• huggingface / picotron_tutorial
  ☆224Updated last month
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆70Updated 10 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆176Updated last year
• axon-rl / gem
  A Gym for Agentic LLMs
  ☆420Updated 2 weeks ago
• RobertCsordas / moeut
  ☆91Updated last year
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆614Updated last week