Alternatives and similar repositories for TPO

Users that are interested in TPO are comparing it to the libraries listed below

• THU-KEG / AdaptThink
  ☆178Updated last month
• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆196Updated 5 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆143Updated 2 months ago
• LightChen233 / reasoning-boundary
  ☆70Updated 7 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆260Updated 8 months ago
• StarDewXXX / O1-Pruner
  Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning
  ☆97Updated 11 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆132Updated 9 months ago
• MingyuJ666 / Disentangling-Memory-and-Reasoning
  [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.
  ☆84Updated 3 months ago
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆156Updated 7 months ago
• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆95Updated 2 months ago
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆164Updated 4 months ago
• yubol-bobo / Awesome-Multi-Turn-LLMs
  This is the official GitHub repository for our survey paper "Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language …
  ☆171Updated 8 months ago
• GAIR-NLP / LIMR
  ☆214Updated 11 months ago
• multimodal-art-projection / REER_DeepWriter
  REverse-Engineered Reasoning for Open-Ended Generation
  ☆91Updated 4 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆87Updated 10 months ago
• KANABOON1 / MemGen
  MemGen: Weaving Generative Latent Memory for Self-Evolving Agents
  ☆290Updated 2 months ago
• GeniusHTX / TALE
  ☆145Updated 4 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆178Updated 6 months ago
• lzhxmu / CPPO
  CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)
  ☆172Updated 3 months ago
• JIA-Lab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆148Updated 8 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Updated 10 months ago
• RUC-NLPIR / Tool-Star
  🔧Tool-Star: Empowering LLM-brained Multi-Tool Reasoner via Reinforcement Learning
  ☆312Updated last month
• NVlabs / Tool-N1
  ☆219Updated 8 months ago
• SuperGPQA / SuperGPQA
  ☆180Updated 9 months ago
• dongguanting / FollowRAG
  The demo, code and data of FollowRAG
  ☆75Updated 7 months ago
• ruixin31 / Spurious_Rewards
  ☆352Updated 6 months ago
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆191Updated last year
• hemingkx / TokenSkip
  [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆200Updated 2 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆73Updated 9 months ago
• ltzheng / SimpleTIR
  [ICLR 2026] End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆351Updated 3 weeks ago