Alternatives and similar repositories for TPO

Users that are interested in TPO are comparing it to the libraries listed below

• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆200Updated 5 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆143Updated 2 months ago
• THU-KEG / AdaptThink
  ☆179Updated 2 months ago
• lzhxmu / CPPO
  CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)
  ☆172Updated 3 months ago
• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆95Updated 3 months ago
• StarDewXXX / O1-Pruner
  Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning
  ☆97Updated 11 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆261Updated 8 months ago
• GAIR-NLP / LIMR
  ☆215Updated 11 months ago
• LightChen233 / reasoning-boundary
  ☆70Updated 7 months ago
• yubol-bobo / Awesome-Multi-Turn-LLMs
  This is the official GitHub repository for our survey paper "Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language …
  ☆171Updated 8 months ago
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆158Updated 7 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆132Updated 9 months ago
• JIA-Lab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆148Updated 8 months ago
• iie-ycx / DEER
  This is the repository of DEER, a Dynamic Early Exit in Reasoning method for Large Reasoning Language Models.
  ☆180Updated 7 months ago
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆164Updated 4 months ago
• multimodal-art-projection / REER_DeepWriter
  REverse-Engineered Reasoning for Open-Ended Generation
  ☆91Updated 5 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆180Updated 7 months ago
• GeniusHTX / TALE
  ☆145Updated 4 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆216Updated 2 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆91Updated 11 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Updated 10 months ago
• ruixin31 / Spurious_Rewards
  ☆352Updated 6 months ago
• MingyuJ666 / Disentangling-Memory-and-Reasoning
  [ACL'25] We propose a novel fine-tuning method, Separate Memory and Reasoning, which combines prompt tuning with LoRA.
  ☆84Updated 3 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆142Updated 10 months ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆75Updated 6 months ago
• sunnweiwei / FoldAgent
  Scaling Long-Horizon LLM Agent via Context-Folding
  ☆106Updated 2 weeks ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆146Updated last year
• KANABOON1 / MemGen
  MemGen: Weaving Generative Latent Memory for Self-Evolving Agents
  ☆298Updated last week
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆88Updated 11 months ago
• LeapLabTHU / limit-of-RLVR
  repo for paper https://arxiv.org/abs/2504.13837
  ☆327Updated last month