open-thought / tiny-grpoLinks
Minimal hackable GRPO implementation
☆281Updated 6 months ago
Alternatives and similar repositories for tiny-grpo
Users that are interested in tiny-grpo are comparing it to the libraries listed below
Sorting:
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆116Updated 3 months ago
- Tina: Tiny Reasoning Models via LoRA☆275Updated last week
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆254Updated 3 months ago
- Notes and commented code for RLHF (PPO)☆104Updated last year
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆438Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆344Updated 8 months ago
- A project to improve skills of large language models☆529Updated this week
- ☆621Updated last month
- minimal GRPO implementation from scratch☆96Updated 5 months ago
- Code for the paper: "Learning to Reason without External Rewards"☆347Updated last month
- Exploring Applications of GRPO☆246Updated last month
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆520Updated last month
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆279Updated last year
- Understanding R1-Zero-Like Training: A Critical Perspective☆1,068Updated last month
- Large Reasoning Models☆804Updated 8 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆765Updated this week
- TTRL: Test-Time Reinforcement Learning☆769Updated last week
- Deepseek R1 zero tiny version own reproduce on two A100s.☆71Updated 6 months ago
- Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".☆269Updated 6 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆121Updated 6 months ago
- ☆129Updated last year
- ☆312Updated 2 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆234Updated 3 months ago
- ☆893Updated last month
- An extension of the nanoGPT repository for training small MOE models.☆178Updated 5 months ago
- ☆955Updated 7 months ago
- RLHF implementation details of OAI's 2019 codebase☆190Updated last year
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆432Updated 3 months ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆327Updated 9 months ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆660Updated 7 months ago