open-thought / tiny-grpoLinks
Minimal hackable GRPO implementation
☆309Updated 11 months ago
Alternatives and similar repositories for tiny-grpo
Users that are interested in tiny-grpo are comparing it to the libraries listed below
Sorting:
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆140Updated 8 months ago
- Tina: Tiny Reasoning Models via LoRA☆312Updated 3 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆609Updated this week
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆271Updated 2 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆575Updated 3 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆284Updated last year
- Understanding R1-Zero-Like Training: A Critical Perspective☆1,181Updated 4 months ago
- Code for the paper: "Learning to Reason without External Rewards"☆385Updated 5 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆366Updated last year
- Large Reasoning Models☆806Updated last year
- Notes and commented code for RLHF (PPO)☆121Updated last year
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆686Updated 11 months ago
- ☆160Updated last year
- minimal GRPO implementation from scratch☆102Updated 9 months ago
- ☆329Updated 7 months ago
- A Gym for Agentic LLMs☆412Updated last week
- ☆1,052Updated 6 months ago
- Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".☆278Updated 10 months ago
- [NeurIPS 2025] TTRL: Test-Time Reinforcement Learning☆945Updated 3 months ago
- Deepseek R1 zero tiny version own reproduce on two A100s.☆82Updated 11 months ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆341Updated last month
- Exploring Applications of GRPO☆251Updated 4 months ago
- RLHF implementation details of OAI's 2019 codebase☆197Updated last year
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆257Updated 7 months ago
- An extension of the nanoGPT repository for training small MOE models.☆224Updated 10 months ago
- ☆102Updated 6 months ago
- [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example☆392Updated last month
- ☆464Updated 4 months ago
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆467Updated 7 months ago
- A project to improve skills of large language models☆734Updated last week