open-thought / tiny-grpoLinks
Minimal hackable GRPO implementation
β252Updated 5 months ago
Alternatives and similar repositories for tiny-grpo
Users that are interested in tiny-grpo are comparing it to the libraries listed below
Sorting:
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)β108Updated 2 months ago
- πΎ OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.β404Updated this week
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"β244Updated 2 months ago
- Understanding R1-Zero-Like Training: A Critical Perspectiveβ1,023Updated 2 weeks ago
- Tina: Tiny Reasoning Models via LoRAβ266Updated last month
- β585Updated 3 months ago
- Large Reasoning Modelsβ805Updated 7 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and trainingβ278Updated last year
- TTRL: Test-Time Reinforcement Learningβ704Updated 2 weeks ago
- Code for the paper: "Learning to Reason without External Rewards"β319Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsβ¦β341Updated 7 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"β497Updated last week
- Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".β268Updated 4 months ago
- β303Updated last month
- Deepseek R1 zero tiny version own reproduce on two A100s.β69Updated 5 months ago
- β824Updated 2 weeks ago
- A project to improve skills of large language modelsβ456Updated this week
- AN O1 REPLICATION FOR CODINGβ335Updated 7 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.β112Updated 5 months ago
- minimal GRPO implementation from scratchβ92Updated 4 months ago
- SkyRL: A Modular Full-stack RL Library for LLMsβ574Updated last week
- An extension of the nanoGPT repository for training small MOE models.β160Updated 4 months ago
- β144Updated 7 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)β652Updated 5 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.β244Updated 3 months ago
- RLHF implementation details of OAI's 2019 codebaseβ187Updated last year
- Notes and commented code for RLHF (PPO)β97Updated last year
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".β98Updated 4 months ago
- ReasonFlux Series - A family of LLM post-training algorithms focusing on data selection, reinforcement learning, and inference scalingβ447Updated last week
- Exploring Applications of GRPOβ240Updated this week