Alternatives and similar repositories for PSFT

Users that are interested in PSFT are comparing it to the libraries listed below

• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆92Updated 2 months ago
• GAIR-NLP / LIMR
  ☆215Updated 10 months ago
• LightChen233 / reasoning-boundary
  ☆70Updated 6 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆143Updated last month
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆55Updated last year
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆60Updated 6 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆95Updated 2 months ago
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆163Updated 3 months ago
• Tim-Siu / reft-exp
  A research repo for experiments about Reinforcement Finetuning
  ☆53Updated 9 months ago
• GAIR-NLP / ToRL
  ☆325Updated 7 months ago
• sunnweiwei / FoldAgent
  ☆90Updated 2 months ago
• THU-KEG / AdaptThink
  ☆176Updated last month
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆154Updated last year
• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆187Updated 4 months ago
• yyht / openrlhf_async_pipline
  ☆87Updated 4 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆257Updated 7 months ago
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆53Updated 10 months ago
• abdelfattah-lab / SplitReason
  ☆21Updated last month
• THUDM / AgentRL
  Scaling Agentic Reinforcement Learning with a Multi-Turn, Multi-Task Framework
  ☆163Updated 3 weeks ago
• ltzheng / SimpleTIR
  End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆347Updated 3 months ago
• hkust-nlp / WebExplorer
  The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"
  ☆90Updated 3 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆139Updated last year
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆91Updated last year
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Updated 9 months ago
• verl-project / verl-recipe
  A set of examples based on verl for end-to-end RL training recipes.
  ☆108Updated this week
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆38Updated last year
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆130Updated 2 months ago
• TIGER-AI-Lab / AceCoder
  The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]
  ☆95Updated 9 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆190Updated 9 months ago