An extension of veRL for post-training LLM reasoners with on-policy self-distillation and self-distilled RLVR + the official codebase for RLRT (Rebellious Student)
☆80Oct 13, 2026Updated 3 weeks ago
Alternatives and similar repositories for self-distillation-analysis
Users that are interested in self-distillation-analysis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆69Oct 16, 2026Updated 3 weeks ago
- Reinforcement Learning via Self-Distillation (SDPO)☆1,145Jul 1, 2026Updated 4 months ago
- On Policy Distillation Build on top of Verl☆106Sep 3, 2026Updated 2 months ago
- ☆22Oct 19, 2026Updated 3 weeks ago
- ☆27May 14, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆34Feb 26, 2025Updated last year
- ☆29Sep 7, 2026Updated 2 months ago
- ☆16May 21, 2026Updated 5 months ago
- ☆733Apr 7, 2026Updated 7 months ago
- [COLM 2026] Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes☆143May 19, 2026Updated 5 months ago
- Open-source RL Framework with Online Teacher-Student Distillation☆23Mar 5, 2026Updated 8 months ago
- ☆18Feb 4, 2026Updated 9 months ago
- The implementation of Teachability-Aware On-Policy Distillation (TA-OPD), the method introduced in Not All Disagreement Is Learnable: Tok…☆22May 25, 2026Updated 5 months ago
- [ICML 2026] An Evaluation Suite for Chain-of-Thought Controllability☆60Mar 10, 2026Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor…☆24Apr 24, 2026Updated 6 months ago
- ☆715Sep 5, 2026Updated 2 months ago
- [ICML 2026] The official repository for Anchored Policy Optimization: Mitigating Exploration Collapse via Support-Constrained Rectificati…☆16Mar 24, 2026Updated 7 months ago
- Code for our ICLR 2023 paper Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examples.☆18May 31, 2023Updated 3 years ago
- Official Code Repository for OmniRetrieval☆36Jun 1, 2026Updated 5 months ago
- ☆13Sep 10, 2025Updated last year
- [ICLR 2025 Oral] Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition☆17Nov 25, 2024Updated last year
- Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information☆35May 14, 2026Updated 5 months ago
- [ICML 2026] Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models☆13May 8, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Reproducible and flexible LLM evaluations for scientific reasoning.☆32Jul 23, 2025Updated last year
- ☆34Oct 13, 2025Updated last year
- The open-source code for the NeurIPS 2025 paper, "Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learn…☆70Jan 5, 2026Updated 10 months ago
- ☆89May 12, 2026Updated 6 months ago
- ☆12Apr 6, 2026Updated 7 months ago
- [ICLR 2026] Monitoring Decomposition Attacks with Lightweight Sequential Monitors☆12Apr 20, 2026Updated 6 months ago
- [ACL 2026 Main] Official Repo for Paper "Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Ali…☆17Jul 1, 2026Updated 4 months ago
- ☆17Apr 17, 2026Updated 6 months ago
- ☆25Jun 10, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A package that achieves 95%+ transfer attack success rate against GPT-4☆26Oct 24, 2024Updated 2 years ago
- Self-Hinting Language Models Enhance Reinforcement Learning☆29Mar 28, 2026Updated 7 months ago
- ☆17Jul 17, 2026Updated 3 months ago
- PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models☆11Jan 19, 2026Updated 9 months ago
- Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"☆11Jan 10, 2025Updated last year
- [TMLR] Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe☆1,068Updated this week
- JAX implementation of configurable LLM distillation training☆24Nov 15, 2025Updated 11 months ago
Are these results useful?