Alternatives and similar repositories for tiny-grpo

Users that are interested in tiny-grpo are comparing it to the libraries listed below

• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆136Updated 7 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆582Updated last month
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆310Updated 2 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆360Updated last year
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆270Updated 2 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆218Updated 9 months ago
• sunblaze-ucb / Intuitor
  Code for the paper: "Learning to Reason without External Rewards"
  ☆383Updated 5 months ago
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆806Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆100Updated 9 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆565Updated 2 months ago
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆282Updated last year
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,173Updated 3 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆665Updated this week
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆250Updated 3 months ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆340Updated last month
• RyanLiu112 / compute-optimal-tts
  Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".
  ☆277Updated 10 months ago
• eddycmu / demystify-long-cot
  ☆329Updated 6 months ago
• ADaM-BJTU / O1-CODER
  AN O1 REPLICATION FOR CODING
  ☆337Updated last year
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆328Updated 7 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆149Updated 10 months ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆686Updated 11 months ago
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆248Updated 8 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆120Updated last year
• JerryWu-code / TinyZero
  Deepseek R1 zero tiny version own reproduce on two A100s.
  ☆77Updated 10 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆159Updated last year
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆115Updated 4 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆181Updated 6 months ago
• axon-rl / gem
  A Gym for Agentic LLMs
  ☆404Updated last month
• Gen-Verse / ReasonFlux
  [NeurIPS 2025 Spotlight] ReasonFlux (long-CoT), ReasonFlux-PRM (process reward model) and ReasonFlux-Coder (code generation)
  ☆508Updated 2 months ago
• huggingface / Math-Verify
  ☆1,035Updated 5 months ago