Alternatives and similar repositories for VinePPO

Users that are interested in VinePPO are comparing it to the libraries listed below

• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated 11 months ago
• abdulhaim / LMRL-Gym
  ☆99Updated last year
• jwhj / OREO
  ☆114Updated 6 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆161Updated 4 months ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆185Updated 3 months ago
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆279Updated last year
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆63Updated 9 months ago
• GFNOrg / gfn-lm-tuning
  ☆184Updated last year
• axon-rl / gem
  A Gym for Generalist LLMs
  ☆73Updated this week
• vwxyzjn / summarize_from_feedback_details
  ☆147Updated 8 months ago
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated last year
• WeiXiongUST / Building-Math-Agents-with-Multi-Turn-Iterative-Preference-Learning
  This is an official implementation of the paper ``Building Math Agents with Multi-Turn Iterative Preference Learning'' with multi-turn DP…
  ☆28Updated 8 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆114Updated 4 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆59Updated 3 months ago
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆118Updated 3 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆118Updated 6 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆131Updated 5 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆113Updated last year
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆44Updated last year
• LLM360 / Reasoning360
  A repo for open research on building large reasoning models
  ☆87Updated this week
• architsharma97 / dpo-rlaif
  ☆99Updated last year
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆69Updated 5 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆238Updated this week
• kanishkg / cognitive-behaviors
  ☆203Updated 4 months ago
• thu-wyz / inference_scaling
  ☆71Updated 8 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆58Updated last year
• spiral-rl / spiral
  SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learning
  ☆130Updated this week
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆168Updated last year
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆61Updated 6 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆104Updated 2 weeks ago