Alternatives and similar repositories for VinePPO

Users that are interested in VinePPO are comparing it to the libraries listed below

• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆125Updated last year
• abdulhaim / LMRL-Gym
  ☆106Updated last year
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆198Updated 7 months ago
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆66Updated last year
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆168Updated 8 months ago
• jwhj / OREO
  ☆117Updated 10 months ago
• thinking-machines-lab / tinker-project-ideas
  Ideas for projects related to Tinker
  ☆120Updated last month
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆283Updated last year
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆123Updated 8 months ago
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆134Updated 3 months ago
• GFNOrg / gfn-lm-tuning
  ☆185Updated last year
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆47Updated last year
• axon-rl / gem
  A Gym for Agentic LLMs
  ☆395Updated last month
• ryoungj / ObsScaling
  [NeurIPS'24 Spotlight] Observational Scaling Laws
  ☆59Updated last year
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆116Updated 4 months ago
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆31Updated last year
• WeiXiongUST / Building-Math-Agents-with-Multi-Turn-Iterative-Preference-Learning
  This is an official implementation of the paper ``Building Math Agents with Multi-Turn Iterative Preference Learning'' with multi-turn DP…
  ☆30Updated last year
• kanishkg / cognitive-behaviors
  ☆217Updated 8 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆122Updated 10 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆68Updated 9 months ago
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆92Updated 5 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆159Updated last year
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆62Updated 2 years ago
• expz / quiet-star
  Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)
  ☆54Updated last year
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆326Updated last year
• thu-wyz / inference_scaling
  ☆76Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆85Updated 9 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆80Updated 11 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆67Updated 7 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 10 months ago