superlinear-ai / microGRPOLinks
🐭 A tiny single-file implementation of Group Relative Policy Optimization (GRPO) as introduced by the DeepSeekMath paper
☆38Updated 4 months ago
Alternatives and similar repositories for microGRPO
Users that are interested in microGRPO are comparing it to the libraries listed below
Sorting:
- [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)☆20Updated last year
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆210Updated 2 years ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆179Updated 5 months ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆64Updated 6 months ago
- ☆153Updated 11 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆116Updated 2 weeks ago
- Simple repository for training small reasoning models☆44Updated 9 months ago
- An implementation of PPO in Pytorch☆97Updated this week
- Learn online intrinsic rewards from LLM feedback☆44Updated 10 months ago
- ☆128Updated last year
- ☆116Updated 9 months ago
- ☆154Updated 2 months ago
- Reinforcement learning training framework for entity-gym environments.☆17Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆47Updated 10 months ago
- Flax (Jax) implementation of DeepSeek-R1-Distill-Qwen-1.5B with weights ported from Hugging Face.☆25Updated 8 months ago
- ☆106Updated 2 weeks ago
- Minimal hackable GRPO implementation☆299Updated 9 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆125Updated 6 months ago
- ☆106Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆151Updated 9 months ago
- Interpreting how transformers simulate agents performing RL tasks☆88Updated 2 years ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆139Updated 9 months ago
- ☆36Updated 2 years ago
- Skill Design From AI Feedback☆31Updated 8 months ago
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆32Updated last year
- CleanRL's implementation of DeepMind's Podracer Sebulba Architecture for Distributed DRL☆117Updated last year
- Evaluation of neuro-symbolic engines☆39Updated last year
- Minimal RLHF implementation built on top of minGPT.☆30Updated last year
- Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients☆26Updated last year