[ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repository contains the code, configurations, and experiment assets for the project.
☆24Apr 24, 2026Updated 4 months ago
Alternatives and similar repositories for Hybrid-Policy-Distillation
Users that are interested in Hybrid-Policy-Distillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for the paper "Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolation"☆290May 28, 2026Updated 2 months ago
- A Teacher–Student Cooperation Framework to Synthesize Student-Consistent SFT Data☆37May 1, 2026Updated 3 months ago
- The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".☆18Jan 4, 2026Updated 7 months ago
- Beyond SFT-to-RL: Pre-alignment via Black-BoxOn-Policy Distillation for Multimodal RL☆99May 6, 2026Updated 3 months ago
- Codebase for the work “Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?”☆75Apr 14, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆34Jun 29, 2026Updated last month
- MemSearcher is a search agent that keeps a compact, iteratively-updated memory instead of the full interaction history, trained end-to-en…☆29Jun 29, 2026Updated last month
- A Paper List for Math Word Problem☆20Oct 25, 2023Updated 2 years ago
- PyTorch-based open-source code for paper "SOD: Step-wise On-policy Distillation for Small Language Model Agents"☆159May 22, 2026Updated 3 months ago
- [ACL 2025] Cautious Next Token Prediction☆16Jul 24, 2025Updated last year
- Source code to accompany research paper on training multi token prediction language models using self-distillation.☆39Feb 21, 2026Updated 6 months ago
- ☆589May 10, 2026Updated 3 months ago
- [ICLR'26 Oral] LLM DNA: Tracing Model Evolution via Functional Representations☆32Apr 8, 2026Updated 4 months ago
- Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe☆57Jun 10, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆32Jun 18, 2026Updated 2 months ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated last year
- Official code for "Breaking the Ceiling in On-Policy Distillation via Multi-Agent Debate" (arXiv:2605.01347).☆36Jul 31, 2026Updated 3 weeks ago
- This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"☆19May 30, 2025Updated last year
- [CVPR 2026] MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agent☆37Aug 19, 2026Updated last week
- ☆22Oct 22, 2024Updated last year
- Awesome List for On-Policy Distillation☆842Jul 31, 2026Updated 3 weeks ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆92Feb 14, 2025Updated last year
- Deep Research as Rubric for Reinforcement Learning☆25Jun 30, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- HSTGODE code☆11Nov 26, 2023Updated 2 years ago
- RENT (Reinforcement Learning via Entropy Minimization) is an unsupervised method for training reasoning LLMs.☆42Oct 31, 2025Updated 9 months ago
- Voronoi-Based Foveated Volume Rendering☆10Sep 30, 2021Updated 4 years ago
- ☆27May 12, 2026Updated 3 months ago
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated last year
- Source Code for our ICLR'26 paper☆17Feb 22, 2026Updated 6 months ago
- UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Y…☆16Sep 30, 2024Updated last year
- Repo for paper "Rethinking Generalization in Reasoning SFT: A Conditional Analysis on Optimization, Data, and Model Capability"☆109Aug 15, 2026Updated last week
- [ACL 2026] VGPO: Visually-Guided Policy Optimization for Multimodal Reasoning☆33Apr 14, 2026Updated 4 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [ICML 2026] Spherical Steering: Geometry-Aware Activation Rotation for Language Models☆21May 19, 2026Updated 3 months ago
- Non-Autoregressive Math Word Problem Solver with Unified Tree Structure☆12Jan 13, 2024Updated 2 years ago
- ☆14May 21, 2024Updated 2 years ago
- Fully open reproduction of DeepSeek-R1☆11Mar 24, 2025Updated last year
- ☆80May 8, 2026Updated 3 months ago
- ☆29Mar 12, 2025Updated last year
- [ICML 2026] This is the official implementation for paper HiPER: Hierarchical Reinforcement Learning with Explicit Credit Assignment for …☆26Jun 24, 2026Updated 2 months ago