Alternatives and similar repositories for BuPO

Users that are interested in BuPO are comparing it to the libraries listed below

• multimodal-art-projection / TreePO
  ☆54Updated 2 months ago
• Interplay-LM-Reasoning / Interplay-LM-Reasoning
  ☆105Updated 2 weeks ago
• ritzz-ai / PACS
  ☆30Updated 3 months ago
• lichengliu03 / unary-feedback
  ☆41Updated 4 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆126Updated 8 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated last year
• MiniMax-AI / SynLogic
  [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond
  ☆187Updated 5 months ago
• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆91Updated last month
• test-time-interaction / TTI
  ☆68Updated 6 months ago
• rhyang2021 / ARIA
  Source code for our paper: "ARIA: Training Language Agents with Intention-Driven Reward Aggregation".
  ☆25Updated 4 months ago
• TingchenFu / MathIF
  instruction-following benchmark for large reasoning models
  ☆44Updated 4 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆118Updated 7 months ago
• THUDM / TreeRL
  TreeRL: LLM Reinforcement Learning with On-Policy Tree Search in ACL'25
  ☆84Updated 6 months ago
• hkust-nlp / model-task-align-rl
  The official code repository for the paper "Mirage or Method? How Model–Task Alignment Induces Divergent RL Conclusions".
  ☆15Updated 3 months ago
• hkust-nlp / GUIMid
  ☆21Updated 7 months ago
• yayayacc / MUR
  ☆46Updated 2 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆211Updated last month
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆72Updated 8 months ago
• ReasoningTransfer / Transferability-of-LLM-Reasoning
  ☆106Updated 2 weeks ago
• mukhal / ThinkPRM
  Process Reward Models That Think
  ☆67Updated last month
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning
  ☆144Updated 3 months ago
• LLM360 / Reasoning360
  A repo for open research on building large reasoning models
  ☆125Updated this week
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆70Updated 5 months ago
• zhijie-group / SIFT
  SIFT: Grounding LLM Reasoning in Contexts via Stickers
  ☆57Updated 9 months ago
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆182Updated 5 months ago
• TIGER-AI-Lab / Hierarchical-Reasoner
  Emergent Hierarchical Reasoning in LLMs/VLMs through Reinforcement Learning
  ☆53Updated 2 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆45Updated 3 months ago
• TIGER-AI-Lab / AceCoder
  The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]
  ☆94Updated 8 months ago
• opendatalab / REST
  ☆32Updated 5 months ago
• RUCAIBox / Passk_Training
  The official repository of paper "Pass@k Training for Adaptively Balancing Exploration and Exploitation of Large Reasoning Models''
  ☆110Updated 4 months ago