Alternatives and similar repositories for GRPO

Users that are interested in GRPO are comparing it to the libraries listed below

• thu-coai / SPaR
  ☆47Updated 5 months ago
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆89Updated 5 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆95Updated 2 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆141Updated 6 months ago
• jwhj / OREO
  ☆114Updated 4 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆59Updated 4 months ago
• gkamradt / SnakeBench
  ☆86Updated 2 weeks ago
• THUDM / T1
  Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
  ☆104Updated 4 months ago
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆62Updated 3 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated this week
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆105Updated 3 weeks ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 3 months ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆58Updated 2 months ago
• Gabesarch / ICAL
  ☆40Updated 3 weeks ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆89Updated last week
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆82Updated 2 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• jwliao-ai / MARFT
  MARFT stands for Multi-Agent Reinforcement Fine-Tuning. This repository implements an LLM-based multi-agent reinforcement fine-tuning fra…
  ☆35Updated 2 weeks ago
• amazon-science / PAE
  ☆59Updated 3 months ago
• GAIR-NLP / PC-Agent-E
  Efficient Agent Training for Computer Use
  ☆94Updated last week
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆54Updated last month
• swtheing / PF-PPO-RLHF
  ☆33Updated 8 months ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆140Updated 3 months ago
• THU-KEG / Agentic-Reward-Modeling
  Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆91Updated 3 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆102Updated last year
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆29Updated last year
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆54Updated 9 months ago
• PRIME-RL / Entropy-Mechanism-of-RL
  The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.
  ☆103Updated this week
• ygjin11 / r2-play
  The official implementation of the paper "Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction".
  ☆34Updated last year