Alternatives and similar repositories for weak-to-strong-preference-optimization

Users that are interested in weak-to-strong-preference-optimization are comparing it to the libraries listed below

• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆88Updated 10 months ago
• ZJU-REAL / EasySteer
  A Unified Framework for High-Performance and Extensible LLM Steering
  ☆137Updated 2 weeks ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆27Updated 10 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆50Updated 5 months ago
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆71Updated 11 months ago
• StarDewXXX / AdaR1
  The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"
  ☆20Updated last month
• ZhentingWang / DUMP
  ☆34Updated 7 months ago
• wang8740 / MAP
  Documentation at
  ☆13Updated 8 months ago
• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆72Updated 7 months ago
• QingyangZhang / EMPO
  [NeurIPS25 Spotlight] EMPO, A Fully Unsupervised RLVR Method
  ☆87Updated 3 weeks ago
• GaryStack / MMR-V
  Official repository of the video reasoning benchmark MMR-V. Can Your MLLMs "Think with Video"?
  ☆36Updated 5 months ago
• Hongcheng-Gao / HAVEN
  Code and data for paper "Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation".
  ☆24Updated last month
• uservan / ThinkPO
  ☆17Updated 4 months ago
• aeroplanepaper / GRPO-LEAD
  ☆31Updated last month
• MikeWangWZHL / dymu
  ☆23Updated 7 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆148Updated 5 months ago
• limenlp / verl
  AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
  ☆49Updated 6 months ago
• Alsace08 / Chain-of-Embedding
  [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
  ☆90Updated last year
• sail-sg / ActivePRM
  ☆19Updated 8 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆46Updated last year
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆51Updated 2 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆124Updated 8 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆86Updated 6 months ago
• wicai24 / DOOR-Alignment
  ☆16Updated 8 months ago
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆70Updated 6 months ago
• alchemistyzz / PeRL
  [NeurIPS'25] The official code of "PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning"
  ☆27Updated 2 months ago
• SophieZheng998 / ALI-Agent
  Official implementation for "ALI-Agent: Assessing LLMs'Alignment with Human Values via Agent-based Evaluation"
  ☆21Updated 4 months ago
• thu-nics / TaH
  Official implementation of paper "Think-at-Hard: Selective Latent Iterations to Improve Reasoning Language Models"
  ☆52Updated last week
• Kamichanw / CoS
  [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"
  ☆28Updated 5 months ago
• ShadeCloak / ADORA
  ☆46Updated 8 months ago