Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
☆195May 25, 2025Updated last year
Alternatives and similar repositories for VinePPO
Users that are interested in VinePPO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆210Apr 17, 2025Updated last year
- B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners☆86May 21, 2025Updated last year
- This repository is the official implementation of Learning Goal-Conditioned Representations for Language Reward Models☆11Dec 14, 2024Updated last year
- ☆226Mar 26, 2025Updated last year
- ☆34Sep 14, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Self-Supervised Alignment with Mutual Information☆20May 24, 2024Updated 2 years ago
- ☆334May 31, 2025Updated last year
- [ICLR 2026] RPG: KL-Regularized Policy Gradient (https://arxiv.org/abs/2505.17508)☆78Jun 29, 2026Updated 4 months ago
- A Gym for Agentic LLMs☆511Jan 21, 2026Updated 9 months ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models (ICLR 2025)☆70Oct 19, 2026Updated last week
- Code for paper "The Markovian Thinker: Architecture-Agnostic Linear Scaling of Reasoning"☆350Mar 16, 2026Updated 7 months ago
- Scalable RL solution for advanced reasoning of language models☆1,873Mar 18, 2025Updated last year
- The code and data for the paper JiuZhang3.0☆49May 26, 2024Updated 2 years ago
- Recipes to train reward model for RLHF.☆1,545Apr 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Models☆56Sep 19, 2025Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆124Sep 9, 2024Updated 2 years ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆120Dec 10, 2024Updated last year
- Regressing the Relative Future: Efficient Policy Optimization for Multi-turn RLHF☆25Oct 8, 2024Updated 2 years ago
- Simple RL training for reasoning☆3,881Dec 23, 2025Updated 10 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆438Aug 5, 2026Updated 2 months ago
- Understanding R1-Zero-Like Training: A Critical Perspective☆1,285Aug 27, 2025Updated last year
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆25Oct 7, 2025Updated last year
- RL Scaling and Test-Time Scaling (ICML'25)☆116Jan 23, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"☆398Jan 19, 2025Updated last year
- Get language models to generate responses in a specific format reliably. Open source implementation of Synchromesh: Reliable code generat…☆33Feb 26, 2024Updated 2 years ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆180Jul 8, 2025Updated last year
- The code for paper "EPO: Entropy-regularized Policy Optimization for LLM Agents Reinforcement Learning"☆40Jul 13, 2026Updated 3 months ago
- ☆30Jan 31, 2026Updated 8 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆149Nov 26, 2024Updated last year
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆674Jan 29, 2026Updated 9 months ago
- A bibliography and survey of the papers surrounding o1☆1,214Jul 7, 2026Updated 3 months ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆333Jan 29, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Codebase for the rational policy gradient algorithm and paper.☆13Nov 13, 2025Updated 11 months ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆336Apr 24, 2025Updated last year
- ☆127Jun 2, 2026Updated 4 months ago
- Official Repo for Open-Reasoner-Zero☆2,100Jun 2, 2025Updated last year
- A flexible and efficient training framework for large-scale alignment tasks☆451Oct 23, 2025Updated last year
- Codebase for HiP☆90Dec 15, 2023Updated 2 years ago
- Code for "Language Models Can Learn from Verbal Feedback Without Scalar Rewards"☆65Jan 5, 2026Updated 9 months ago