Alternatives and similar repositories for weak-to-strong-preference-optimization

Users that are interested in weak-to-strong-preference-optimization are comparing it to the libraries listed below

• wang8740 / MAP
  Documentation at
  ☆13Updated 9 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆88Updated 10 months ago
• aeroplanepaper / GRPO-LEAD
  ☆31Updated last month
• sail-sg / ActivePRM
  ☆19Updated 8 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆72Updated 8 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆50Updated 5 months ago
• Kamichanw / CoS
  [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"
  ☆28Updated 6 months ago
• ZhentingWang / DUMP
  ☆34Updated 7 months ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆28Updated 10 months ago
• limenlp / verl
  AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
  ☆49Updated 6 months ago
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆72Updated 11 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆45Updated 3 months ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆50Updated last year
• ShadeCloak / ADORA
  ☆46Updated 8 months ago
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆64Updated last year
• ChnQ / MI-Peaks
  ☆59Updated 5 months ago
• shivamag125 / EM_PT
  ☆24Updated 4 months ago
• GaryStack / MMR-V
  Official repository of the video reasoning benchmark MMR-V. Can Your MLLMs "Think with Video"?
  ☆36Updated 6 months ago
• rookie-joe / AutoPSV
  ☆51Updated last year
• RUCBM / DeepCritic
  Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"
  ☆40Updated 6 months ago
• yihuaihong / Dissecting-FT-Unlearning
  ☆15Updated last year
• StarDewXXX / AdaR1
  The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"
  ☆20Updated last month
• TrustedLLM / UnKE
  ☆22Updated 10 months ago
• TEAM-ARM / arm
  [NeurIPS'25 Spotlight] ARM: Adaptive Reasoning Model
  ☆62Updated 2 months ago
• zzzhr97 / SpecBench
  ☆22Updated last month
• lzhxmu / CPPO
  CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)
  ☆169Updated last month
• ZJU-REAL / LAPO
  ☆36Updated 2 months ago
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆86Updated 10 months ago
• Joshua-Ren / Learning_dynamics_LLM
  ☆197Updated this week
• MikeWangWZHL / dymu
  ☆23Updated 7 months ago