Alternatives and similar repositories for verl

Users that are interested in verl are comparing it to the libraries listed below

• NineAbyss / S2R
  This is the official implementation of the paper "S²R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning"
  ☆67Updated 2 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆112Updated 3 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆82Updated last month
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆154Updated 4 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆36Updated 2 months ago
• rookie-joe / AutoPSV
  ☆46Updated 8 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆60Updated 7 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆124Updated 3 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆32Updated 2 months ago
• NJU-RL / GLIDER
  [ICML 2025] Official Implementation of GLIDER
  ☆46Updated last month
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆60Updated 5 months ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆55Updated 2 weeks ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆141Updated 5 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 10 months ago
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆63Updated 8 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆146Updated 8 months ago
• jwhj / OREO
  ☆114Updated 5 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated 10 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆102Updated 2 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆33Updated 9 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆60Updated 8 months ago
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆49Updated 8 months ago
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆74Updated 5 months ago
• kanishkg / cognitive-behaviors
  ☆199Updated 3 months ago
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated last year
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆22Updated 6 months ago
• FreedomIntelligence / OVM
  ☆67Updated last year
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆55Updated 7 months ago
• PRIME-RL / Entropy-Mechanism-of-RL
  The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.
  ☆237Updated 2 weeks ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆61Updated 6 months ago