Alternatives and similar repositories for GRPO:

Users that are interested in GRPO are comparing it to the libraries listed below

• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆87Updated 4 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆137Updated 5 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆100Updated last week
• THU-KEG / Agentic-Reward-Modeling
  Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆86Updated last month
• THUDM / T1
  Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
  ☆101Updated 3 months ago
• dllm-reasoning / d1
  Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"
  ☆77Updated last week
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆28Updated last year
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆56Updated 2 months ago
• jwhj / OREO
  ☆107Updated 3 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆55Updated 2 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated 2 weeks ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆95Updated last month
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• Gabesarch / ICAL
  ☆36Updated last month
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆54Updated 3 weeks ago
• thu-coai / SPaR
  ☆47Updated 4 months ago
• nick7nlp / FastCuRL
  FastCuRL: Curriculum Reinforcement Learning with Progressive Context Extension for Efficient Training R1-like Reasoning Models
  ☆43Updated last week
• GuanghaoYe / Emergence-of-Thinking
  ☆50Updated 2 months ago
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆55Updated 2 weeks ago
• iamhankai / Forest-of-Thought
  Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
  ☆38Updated 2 months ago
• amazon-science / PAE
  ☆55Updated last month
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆84Updated last month
• architsharma97 / dpo-rlaif
  ☆96Updated 9 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆42Updated 4 months ago
• DigiRL-agent / digiq
  ☆101Updated 2 weeks ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆55Updated this week
• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆154Updated last month
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆79Updated 2 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆63Updated 10 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆98Updated last year