Alternatives and similar repositories for tiny-grpo

Users that are interested in tiny-grpo are comparing it to the libraries listed below

• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆623Updated last week
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆143Updated 9 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆589Updated 4 months ago
• shangshang-wang / Tina
  [ICLR 2026] Tina: Tiny Reasoning Models via LoRA
  ☆319Updated 4 months ago
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,205Updated 5 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆371Updated last year
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆807Updated last year
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆285Updated last year
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆251Updated 5 months ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆273Updated 3 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆236Updated 11 months ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆344Updated 2 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 10 months ago
• RyanLiu112 / compute-optimal-tts
  Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".
  ☆283Updated 11 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆124Updated last year
• huggingface / picotron_tutorial
  ☆232Updated 2 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆162Updated last year
• sunblaze-ucb / Intuitor
  [ICLR 2026] Learning to Reason without External Rewards
  ☆389Updated 2 weeks ago
• eddycmu / demystify-long-cot
  ☆330Updated 8 months ago
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,547Updated this week
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆197Updated 2 years ago
• axon-rl / gem
  A Gym for Agentic LLMs
  ☆444Updated 2 weeks ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆691Updated last year
• JerryWu-code / TinyZero
  Deepseek R1 zero tiny version own reproduce on two A100s.
  ☆84Updated last year
• PRIME-RL / TTRL
  [NeurIPS 2025] TTRL: Test-Time Reinforcement Learning
  ☆986Updated 4 months ago
• ADaM-BJTU / O1-CODER
  AN O1 REPLICATION FOR CODING
  ☆334Updated last year
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,124Updated 8 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆813Updated this week
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆331Updated 9 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year