Alternatives and similar repositories for PSFT

Users that are interested in PSFT are comparing it to the libraries listed below

• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆85Updated 4 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆136Updated 6 months ago
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆158Updated last month
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆190Updated 7 months ago
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆50Updated 7 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆152Updated 10 months ago
• GAIR-NLP / LIMR
  ☆211Updated 8 months ago
• yyht / openrlhf_async_pipline
  ☆83Updated 2 months ago
• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆176Updated 2 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆37Updated last year
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆57Updated 4 months ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• ShadeCloak / ADORA
  ☆46Updated 6 months ago
• SkyworkAI / Skywork-Reward-V2
  Scaling Preference Data Curation via Human-AI Synergy
  ☆122Updated 4 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 10 months ago
• MiroMindAI / MiroRL
  MiroRL is an MCP-first reinforcement learning framework for deep research agent.
  ☆169Updated 2 months ago
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆123Updated last week
• THU-KEG / AdaptThink
  ☆157Updated 3 weeks ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆56Updated 11 months ago
• LightChen233 / reasoning-boundary
  ☆68Updated 4 months ago
• MIT-MI / MEM1
  ☆142Updated last week
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆104Updated 10 months ago
• TsinghuaC3I / Unify-Post-Training
  Towards a Unified View of Large Language Model Post-Training
  ☆170Updated last month
• lzhxmu / CPPO
  CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)
  ☆156Updated 2 weeks ago
• multimodal-art-projection / COIG-P
  ☆39Updated 3 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆142Updated 6 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 8 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆109Updated 5 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆135Updated last year
• THUDM / TreeRL
  TreeRL: LLM Reinforcement Learning with On-Policy Tree Search in ACL'25
  ☆74Updated 4 months ago