Alternatives and similar repositories for weak-to-strong-preference-optimization

Users that are interested in weak-to-strong-preference-optimization are comparing it to the libraries listed below

• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆89Updated 11 months ago
• StarDewXXX / AdaR1
  The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"
  ☆21Updated 2 months ago
• yihuaihong / Dissecting-FT-Unlearning
  ☆15Updated last year
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆28Updated 11 months ago
• aeroplanepaper / GRPO-LEAD
  ☆33Updated 2 months ago
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆73Updated last year
• Chengsong-Huang / Self-Calibration
  codes for Efficient Test-Time Scaling via Self-Calibration
  ☆19Updated 4 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆51Updated 6 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆131Updated 9 months ago
• lukahhcm / Awesome_Environment_Scaling
  Resources and paper list for 'Scaling Environments for Agents'. This repository accompanies our survey on how environments contribute to …
  ☆57Updated this week
• Joshua-Ren / Learning_dynamics_LLM
  ☆204Updated last month
• GaryStack / MMR-V
  Official repository of the video reasoning benchmark MMR-V. Can Your MLLMs "Think with Video"?
  ☆38Updated 7 months ago
• sail-sg / ActivePRM
  ☆20Updated 9 months ago
• shivamag125 / EM_PT
  ☆26Updated 5 months ago
• xiaomi-research / colar
  [NeurIPS 2025] Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains
  ☆71Updated 6 months ago
• ZhentingWang / DUMP
  ☆34Updated 8 months ago
• QingyangZhang / EMPO
  [NeurIPS25 Spotlight] EMPO, A Fully Unsupervised RLVR Method
  ☆93Updated 2 months ago
• NuoJohnChen / JudgeLRM
  JudgeLRM: Large Reasoning Models as a Judge
  ☆40Updated last month
• TEAM-ARM / arm
  [NeurIPS'25 Spotlight] ARM: Adaptive Reasoning Model
  ☆64Updated 3 months ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆73Updated 6 months ago
• wang8740 / MAP
  Documentation at
  ☆14Updated 10 months ago
• Alsace08 / Chain-of-Embedding
  [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
  ☆93Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆152Updated 6 months ago
• uservan / ThinkPO
  ☆17Updated 6 months ago
• TrustedLLM / UnKE
  ☆23Updated 11 months ago
• Kamichanw / CoS
  [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"
  ☆28Updated 7 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆73Updated 9 months ago
• Gen-Verse / GenEnv
  ☆45Updated last month
• Lslland / T-Vaccine
  ☆19Updated 7 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 9 months ago