Alternatives and similar repositories for PSFT

Users that are interested in PSFT are comparing it to the libraries listed below

• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆91Updated last month
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆140Updated last month
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆59Updated 6 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆56Updated last year
• MiroMindAI / MiroRL
  MiroRL is an MCP-first reinforcement learning framework for deep research agent.
  ☆182Updated 3 months ago
• GAIR-NLP / LIMR
  ☆213Updated 9 months ago
• THUDM / AgentRL
  Scaling Agentic Reinforcement Learning with a Multi-Turn, Multi-Task Framework
  ☆141Updated 2 weeks ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆92Updated last month
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆181Updated 4 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆190Updated 8 months ago
• yyht / openrlhf_async_pipline
  ☆86Updated 3 months ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆123Updated 8 months ago
• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆181Updated 4 months ago
• RUCAIBox / SimpleDeepSearcher
  SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis
  ☆111Updated 6 months ago
• LightChen233 / reasoning-boundary
  ☆69Updated 5 months ago
• hkust-nlp / WebExplorer
  The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"
  ☆89Updated 2 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆88Updated 11 months ago
• THU-KEG / AdaptThink
  ☆171Updated last week
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆64Updated last year
• TsinghuaC3I / Unify-Post-Training
  Towards a Unified View of Large Language Model Post-Training
  ☆192Updated 3 months ago
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆161Updated 2 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆154Updated 11 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆209Updated 2 weeks ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆37Updated last year
• ReasoningTransfer / Transferability-of-LLM-Reasoning
  ☆104Updated 2 months ago
• abdelfattah-lab / SplitReason
  ☆21Updated last week
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆52Updated 9 months ago
• ltzheng / SimpleTIR
  End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆332Updated 2 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆133Updated 8 months ago