Alternatives and similar repositories for PSFT

Users that are interested in PSFT are comparing it to the libraries listed below

• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆88Updated 2 weeks ago
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆58Updated 5 months ago
• yyht / openrlhf_async_pipline
  ☆86Updated 3 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆190Updated 8 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆37Updated last year
• hkust-nlp / WebExplorer
  The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"
  ☆87Updated last month
• RUCAIBox / SimpleDeepSearcher
  SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis
  ☆110Updated 5 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆138Updated last week
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆153Updated 10 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆63Updated 11 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆56Updated 11 months ago
• GAIR-NLP / LIMR
  ☆212Updated 9 months ago
• SkyworkAI / Skywork-Reward-V2
  Scaling Preference Data Curation via Human-AI Synergy
  ☆128Updated 4 months ago
• yegcjs / mixinglaws
  ☆108Updated 4 months ago
• open-compass / GTA
  [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents
  ☆129Updated 7 months ago
• multimodal-art-projection / COIG-P
  ☆39Updated 4 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆136Updated last year
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆160Updated 2 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆104Updated 11 months ago
• MiroMindAI / MiroRL
  MiroRL is an MCP-first reinforcement learning framework for deep research agent.
  ☆172Updated 2 months ago
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆51Updated 8 months ago
• LightChen233 / reasoning-boundary
  ☆69Updated 5 months ago
• WangHanLinHenry / SPA-RL-Agent
  Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"
  ☆49Updated 2 months ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆150Updated 4 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆88Updated 11 months ago
• THU-KEG / AdaptThink
  ☆165Updated last month
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 9 months ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆49Updated last year
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆89Updated last month