Alternatives and similar repositories for Step-DPO:

Users that are interested in Step-DPO are comparing it to the libraries listed below

• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆306Updated 9 months ago
• MARIO-Math-Reasoning / Super_MARIO
  ☆328Updated 3 months ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆619Updated 3 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆221Updated 4 months ago
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆327Updated last year
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆209Updated last year
• CJReinforce / PURE
  Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"
  ☆112Updated 2 weeks ago
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆261Updated 7 months ago
• ElliottYan / LUFFY
  ☆138Updated this week
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆195Updated last month
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆120Updated last month
• eddycmu / demystify-long-cot
  ☆287Updated last month
• QwenLM / AutoIF
  ☆279Updated 9 months ago
• RyanLiu112 / Awesome-Process-Reward-Models
  A comprehensive collection of process reward models.
  ☆74Updated 2 weeks ago
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆363Updated 8 months ago
• princeton-nlp / LESS
  [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning
  ☆442Updated 6 months ago
• PKU-Alignment / aligner
  [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct
  ☆170Updated 3 months ago
• GAIR-NLP / LIMR
  ☆192Updated 2 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆175Updated last month
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆234Updated 3 weeks ago
• Eclipsess / Awesome-Efficient-Reasoning-LLMs
  Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models
  ☆350Updated last week
• XiaoYee / Awesome_Efficient_LRM_Reasoning
  😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond
  ☆205Updated last week
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆173Updated 5 months ago
• RUCAIBox / Slow_Thinking_with_LLMs
  A series of technical report on Slow Thinking with LLM
  ☆659Updated 3 weeks ago
• GAIR-NLP / ToRL
  ☆153Updated last month
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆123Updated 9 months ago
• Hongcheng-Gao / Awesome-Long2short-on-LRMs
  Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…
  ☆203Updated last week
• kanishkg / cognitive-behaviors
  ☆163Updated last month
• jianghoucheng / AlphaEdit
  AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models, ICLR 2025 (Outstanding Paper)
  ☆207Updated 2 weeks ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆138Updated 2 months ago