Alternatives and similar repositories for GRPO

Users that are interested in GRPO are comparing it to the libraries listed below

• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆87Updated 4 months ago
• jwhj / OREO
  ☆110Updated 3 months ago
• THU-KEG / Agentic-Reward-Modeling
  Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆90Updated 2 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆57Updated 3 months ago
• jwliao-ai / MARFT
  ☆28Updated last week
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆85Updated last month
• thu-coai / SPaR
  ☆47Updated 5 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆99Updated last year
• THUDM / T1
  Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
  ☆101Updated 3 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆93Updated 2 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated last week
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆104Updated last week
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆59Updated last month
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆28Updated last year
• Parallel-Reasoning / APR
  Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆81Updated 3 weeks ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆58Updated last month
• tianyi-lab / MoE-Embedding
  Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆68Updated 7 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆43Updated 5 months ago
• gkamradt / SnakeBench
  ☆84Updated 2 weeks ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆64Updated 11 months ago
• amazon-science / PAE
  ☆58Updated 2 months ago
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• thu-wyz / inference_scaling
  ☆66Updated 5 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆138Updated 5 months ago
• Cornell-RL / drpo
  Dateset Reset Policy Optimization
  ☆30Updated last year
• agentification / RAFA_code
  ☆142Updated last year
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆48Updated 6 months ago
• abacusai / smaug
  ☆71Updated last year
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated 3 weeks ago