Alternatives and similar repositories for MPO

Users that are interested in MPO are comparing it to the libraries listed below

• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆104Updated 11 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆63Updated last year
• RUCAIBox / SimpleDeepSearcher
  SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis
  ☆110Updated 5 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆138Updated 6 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆152Updated last year
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆56Updated 11 months ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆114Updated 3 months ago
• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆85Updated this week
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆132Updated 8 months ago
• LightChen233 / reasoning-boundary
  ☆69Updated 4 months ago
• ADaM-BJTU / OpenRFT
  OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning
  ☆152Updated 10 months ago
• satori-reasoning / Satori
  [ICML 2025] Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search
  ☆109Updated 5 months ago
• jwhj / OREO
  ☆116Updated 9 months ago
• hkust-nlp / WebExplorer
  The official repo of "WebExplorer: Explore and Evolve for Training Long-Horizon Web Agents"
  ☆87Updated last month
• dvlab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆135Updated 5 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆198Updated 2 weeks ago
• thu-coai / SPaR
  ☆46Updated 5 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆62Updated 11 months ago
• inclusionAI / PromptCoT
  A unified suite for generating elite reasoning problems and training high-performance LLMs, including pioneering attention-free architect…
  ☆126Updated 2 weeks ago
• MIT-MI / MEM1
  ☆153Updated 2 weeks ago
• NumberChiffre / mcts-llm
  ☆96Updated 10 months ago
• ADaM-BJTU / AutoCoA
  AutoCoA (Automatic generation of Chain-of-Action) is an agent model framework that enhances the multi-turn tool usage capability of reaso…
  ☆129Updated 7 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆91Updated 7 months ago
• ltzheng / SimpleTIR
  End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆318Updated last month
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆154Updated 10 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆115Updated 6 months ago
• open-compass / GTA
  [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents
  ☆128Updated 7 months ago
• hzy312 / knowledge-r1
  IKEA: Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent
  ☆66Updated 6 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆64Updated 9 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆131Updated 7 months ago