Alternatives and similar repositories for PSFT

Users that are interested in PSFT are comparing it to the libraries listed below

• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆95Updated 2 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆143Updated 2 months ago
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆60Updated 7 months ago
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆164Updated 4 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆55Updated last year
• GAIR-NLP / LIMR
  ☆215Updated 11 months ago
• hkust-nlp / WebExplorer
  The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"
  ☆98Updated 4 months ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• TsinghuaC3I / Unify-Post-Training
  Towards a Unified View of Large Language Model Post-Training
  ☆199Updated 4 months ago
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆132Updated 3 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆93Updated last year
• yyht / openrlhf_async_pipline
  ☆87Updated 5 months ago
• LightChen233 / reasoning-boundary
  ☆70Updated 7 months ago
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆182Updated 6 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆98Updated 3 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆155Updated last year
• verl-project / verl-recipe
  A set of examples based on verl for end-to-end RL training recipes.
  ☆139Updated last week
• Tim-Siu / reft-exp
  A research repo for experiments about Reinforcement Finetuning
  ☆53Updated 9 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆39Updated last year
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆259Updated 8 months ago
• hkust-nlp / Laser
  [ICLR2026] Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
  ☆62Updated 8 months ago
• WangHanLinHenry / SPA-RL-Agent
  Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"
  ☆62Updated 4 months ago
• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆191Updated 5 months ago
• THUDM / AgentRL
  Scaling Agentic Reinforcement Learning with a Multi-Turn, Multi-Task Framework
  ☆196Updated last week
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆120Updated last year
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆71Updated 6 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆191Updated 10 months ago
• multimodal-art-projection / COIG-P
  ☆39Updated 6 months ago
• multimodal-art-projection / KORGym
  ☆53Updated 8 months ago
• GAIR-NLP / ToRL
  ☆329Updated 8 months ago