Alternatives and similar repositories for SPO

Users that are interested in SPO are comparing it to the libraries listed below

• ElliottYan / LUFFY
  Official Repository of "Learning to Reason under Off-Policy Guidance"
  ☆240Updated 3 weeks ago
• CJReinforce / PURE
  Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"
  ☆125Updated last week
• Open-DataFlow / Awesome_MLLMs_Reasoning
  ☆101Updated this week
• QingyangZhang / Label-Free-RLVR
  ☆222Updated this week
• RyanLiu112 / Awesome-Process-Reward-Models
  A comprehensive collection of process reward models.
  ☆92Updated 2 weeks ago
• PRIME-RL / Entropy-Mechanism-of-RL
  The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.
  ☆191Updated this week
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆75Updated 3 weeks ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆80Updated 5 months ago
• GAIR-NLP / ToRL
  ☆220Updated last month
• ruixin31 / Spurious_Rewards
  ☆292Updated last week
• RAGEN-AI / VAGEN
  ☆169Updated this week
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆113Updated 2 months ago
• LightChen233 / M3CoT
  ☆74Updated last year
• Blueyee / Efficient-CoT-LRMs
  Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!
  ☆54Updated 2 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆54Updated 6 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆144Updated 6 months ago
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆130Updated 2 months ago
• LeapLabTHU / limit-of-RLVR
  repo for paper https://arxiv.org/abs/2504.13837
  ☆158Updated last month
• 0russwest0 / Awesome-Agent-RL
  ☆242Updated last month
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆222Updated last month
• mat-agent / MAT-Agent
  ☆46Updated last week
• ShadeCloak / ADORA
  ☆46Updated 2 months ago
• GAIR-NLP / LIMR
  ☆203Updated 4 months ago
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆73Updated 4 months ago
• qiancheng0 / ToolRL
  ☆241Updated 2 weeks ago
• ADaM-BJTU / Mind_with_eyes_Awesome_MLLMs_Reasoning
  This repository will continuously update the latest papers, technical reports, benchmarks about multimodal reasoning!
  ☆45Updated 3 months ago
• Hongcheng-Gao / Awesome-Long2short-on-LRMs
  Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…
  ☆228Updated 2 weeks ago
• TsinghuaC3I / MARTI
  A Framework for LLM-based Multi-Agent Reinforced Training and Inference
  ☆136Updated last week
• TIGER-AI-Lab / verl-tool
  A version of verl to support tool use
  ☆251Updated this week
• phellonchen / Awesome-MLLM-Reasoning
  Latest Advances on Reasoning of Multimodal Large Language Models (Multimodal R1 \ Visual R1) ) 🍓
  ☆35Updated 2 months ago