open-thought / tiny-grpoLinks
Minimal hackable GRPO implementation
β286Updated 8 months ago
Alternatives and similar repositories for tiny-grpo
Users that are interested in tiny-grpo are comparing it to the libraries listed below
Sorting:
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)β120Updated 4 months ago
- πΎ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.β472Updated 3 weeks ago
- Tina: Tiny Reasoning Models via LoRAβ284Updated 2 weeks ago
- Code for the paper: "Learning to Reason without External Rewards"β357Updated 2 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.β129Updated 8 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"β535Updated 2 months ago
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"β261Updated 4 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsβ¦β343Updated 9 months ago
- Understanding R1-Zero-Like Training: A Critical Perspectiveβ1,100Updated last month
- Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".β271Updated 7 months ago
- β318Updated 4 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and trainingβ280Updated last year
- Exploring Applications of GRPOβ250Updated last month
- Large Reasoning Modelsβ804Updated 10 months ago
- minimal GRPO implementation from scratchβ98Updated 6 months ago
- [NeurIPS 2025] TTRL: Test-Time Reinforcement Learningβ823Updated last week
- A project to improve skills of large language modelsβ568Updated last week
- Notes and commented code for RLHF (PPO)β110Updated last year
- Deepseek R1 zero tiny version own reproduce on two A100s.β71Updated 8 months ago
- RLHF implementation details of OAI's 2019 codebaseβ191Updated last year
- β948Updated 3 months ago
- Parallel Scaling Law for Language Model β Beyond Parameter and Inference Time Scalingβ443Updated 4 months ago
- SkyRL: A Modular Full-stack RL Library for LLMsβ950Updated this week
- β151Updated 10 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)β670Updated 8 months ago
- AN O1 REPLICATION FOR CODINGβ335Updated 9 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).β290Updated last week
- β222Updated this week
- [NeurIPS 2025 Spotlight] ReasonFlux Series - ReasonFlux, ReasonFlux-PRM and ReasonFlux-Coderβ492Updated last week
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.β244Updated 5 months ago