Alternatives and similar repositories for weak-to-strong-preference-optimization

Users that are interested in weak-to-strong-preference-optimization are comparing it to the libraries listed below

• yihuaihong / Dissecting-FT-Unlearning
  ☆14Updated last year
• TrustedLLM / UnKE
  ☆20Updated 8 months ago
• sail-sg / ActivePRM
  ☆19Updated 6 months ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆26Updated 8 months ago
• StarDewXXX / AdaR1
  The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"
  ☆19Updated last month
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆86Updated 8 months ago
• ZhentingWang / DUMP
  ☆30Updated 5 months ago
• wang8740 / MAP
  Documentation at
  ☆12Updated 6 months ago
• wicai24 / DOOR-Alignment
  ☆15Updated 6 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆69Updated 5 months ago
• OPTML-Group / Unlearn-Simple
  [NeurIPS25] Official repo for "Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning"
  ☆33Updated 2 weeks ago
• GaryStack / MMR-V
  Official repository of the video reasoning benchmark MMR-V. Can Your MLLMs "Think with Video"?
  ☆36Updated 3 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆47Updated 3 months ago
• shivamag125 / EM_PT
  ☆21Updated last month
• aeroplanepaper / GRPO-LEAD
  ☆27Updated last month
• Lslland / T-Vaccine
  ☆18Updated 3 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 6 months ago
• eric-ai-lab / MSSBench
  [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"
  ☆26Updated 3 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆44Updated 3 weeks ago
• SophieZheng998 / ALI-Agent
  Official implementation for "ALI-Agent: Assessing LLMs'Alignment with Human Values via Agent-based Evaluation"
  ☆20Updated 2 months ago
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆65Updated 9 months ago
• Kamichanw / CoS
  [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"
  ☆28Updated 3 months ago
• ZJU-REAL / LAPO
  ☆36Updated last week
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆47Updated 3 weeks ago
• hkust-nlp / RL-Verifier-Robustness
  From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.
  ☆23Updated last week
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆60Updated 10 months ago
• EIT-NLP / Distilling-CoT-Reasoning
  [ACL 2025 Findings] Official implementation of the paper "Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning".
  ☆19Updated 7 months ago
• MikeWangWZHL / dymu
  ☆22Updated 5 months ago
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆34Updated 10 months ago
• IBM / SafeLoRA
  Github repo for NeurIPS 2024 paper "Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Models"
  ☆21Updated last month