Alternatives and similar repositories for TPO

Users that are interested in TPO are comparing it to the libraries listed below

• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆157Updated 2 weeks ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆113Updated 2 months ago
• THU-KEG / AdaptThink
  ☆112Updated 3 weeks ago
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆75Updated 2 weeks ago
• LightChen233 / reasoning-boundary
  ☆61Updated this week
• GAIR-NLP / LIMR
  ☆202Updated 4 months ago
• MingyuJ666 / Disentangling-Memory-and-Reasoning
  [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.
  ☆60Updated last month
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆220Updated last month
• StarDewXXX / O1-Pruner
  Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning
  ☆82Updated 4 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆54Updated 6 months ago
• dongguanting / Tool-Star
  Tool-Star: Empowering LLM-brained Multi-Tool Reasoner via Reinforcement Learning
  ☆155Updated this week
• satori-reasoning / Satori
  [ICML 2025] Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search
  ☆99Updated 2 weeks ago
• SihengLi99 / SEALONG
  Large Language Models Can Self-Improve in Long-context Reasoning
  ☆70Updated 6 months ago
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆58Updated 3 weeks ago
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆177Updated 5 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆124Updated 3 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆94Updated 3 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆141Updated last week
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆103Updated last month
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆65Updated 2 months ago
• GAIR-NLP / ToRL
  ☆220Updated 3 weeks ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆105Updated 5 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆65Updated 2 weeks ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆84Updated 6 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆72Updated 2 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆144Updated 5 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆153Updated 3 months ago
• qiancheng0 / ToolRL
  ☆231Updated last week
• yyDing1 / ScaleQuest
  [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆63Updated 7 months ago
• open-compass / GTA
  [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents
  ☆96Updated 2 months ago