Alternatives and similar repositories for GRPO:

Users that are interested in GRPO are comparing it to the libraries listed below

• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆91Updated this week
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆84Updated 3 months ago
• jwhj / OREO
  ☆103Updated 2 months ago
• thu-coai / SPaR
  ☆44Updated 3 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆136Updated 4 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆78Updated 3 weeks ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆94Updated last year
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆86Updated 5 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated 3 weeks ago
• THU-KEG / Agentic-Reward-Modeling
  Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆76Updated 3 weeks ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆162Updated 2 weeks ago
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆53Updated 4 months ago
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• THUDM / T1
  Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
  ☆95Updated 2 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 10 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆140Updated this week
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆50Updated last month
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆51Updated last month
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆80Updated last week
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 9 months ago
• AlphaPav / mem-kk-logic
  On Memorization of Large Language Models in Logical Reasoning
  ☆60Updated this week
• Asap7772 / understanding-rlhf
  ☆25Updated 11 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆39Updated 3 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆64Updated last week
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆131Updated last month
• satori-reasoning / Satori
  ☆84Updated last month
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆85Updated 3 weeks ago
• Gabesarch / ICAL
  ☆35Updated last month
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆138Updated 2 weeks ago
• liziniu / ReMax
  Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)
  ☆179Updated last year