Alternatives and similar repositories for weak-to-strong-preference-optimization

Users that are interested in weak-to-strong-preference-optimization are comparing it to the libraries listed below

• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆63Updated 8 months ago
• ZhentingWang / DUMP
  ☆28Updated 4 months ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆26Updated 7 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆86Updated 7 months ago
• wang8740 / MAP
  Documentation at
  ☆12Updated 6 months ago
• shivamag125 / EM_PT
  ☆19Updated last month
• yihuaihong / Dissecting-FT-Unlearning
  ☆14Updated 11 months ago
• sail-sg / ActivePRM
  ☆18Updated 5 months ago
• QingyangZhang / EMPO
  EMPO, A Fully Unsupervised RLVR Method
  ☆66Updated this week
• aeroplanepaper / GRPO-LEAD
  ☆24Updated last week
• Joshua-Ren / Learning_dynamics_LLM
  ☆167Updated 4 months ago
• GaryStack / MMR-V
  Official repository of the video reasoning benchmark MMR-V. Can Your MLLMs "Think with Video"?
  ☆36Updated 3 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆47Updated 2 months ago
• ChnQ / TracingLLM
  ☆30Updated last year
• TrustedLLM / UnKE
  ☆20Updated 7 months ago
• MurrayTom / SG-Bench
  SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types
  ☆21Updated 9 months ago
• StarDewXXX / AdaR1
  The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"
  ☆18Updated last week
• uservan / ThinkPO
  ☆18Updated last month
• Jihuai-wpy / InferAligner
  ☆35Updated 11 months ago
• IBM / SafeLoRA
  Github repo for NeurIPS 2024 paper "Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Models"
  ☆20Updated last week
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆69Updated 5 months ago
• Chengsong-Huang / Self-Calibration
  codes for Efficient Test-Time Scaling via Self-Calibration
  ☆19Updated 2 weeks ago
• UCSB-NLP-Chang / ThinkPrune
  ☆43Updated 5 months ago
• eric-ai-lab / MSSBench
  [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"
  ☆24Updated 3 months ago
• shawnricecake / Heima
  Code for Heima
  ☆53Updated 5 months ago
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆60Updated 11 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆26Updated 5 months ago
• ShadeCloak / ADORA
  ☆46Updated 5 months ago
• Kamichanw / CoS
  [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"
  ☆27Updated 3 months ago
• hkust-nlp / RL-Verifier-Pitfalls
  Pitfalls of Rule- and Model-based Verifiers: A Case Study on Mathematical Reasoning.
  ☆23Updated 3 months ago