Codebase for the work “Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?”
☆73Apr 14, 2026Updated 3 months ago
Alternatives and similar repositories for self-distillation-analysis
Users that are interested in self-distillation-analysis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆63Jul 3, 2026Updated last week
- On Policy Distillation Build on top of Verl☆90May 25, 2026Updated last month
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆34Feb 26, 2025Updated last year
- ☆470May 10, 2026Updated 2 months ago
- [COLM 2026] Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes☆124May 19, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR 2025 Oral] Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition☆17Nov 25, 2024Updated last year
- A package that achieves 95%+ transfer attack success rate against GPT-4☆26Oct 24, 2024Updated last year
- Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe☆801Jun 29, 2026Updated 2 weeks ago
- ☆19Jun 16, 2026Updated 3 weeks ago
- Code of Self-Distilled RLVR - RLSD☆56May 19, 2026Updated last month
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆60Apr 6, 2025Updated last year
- [ICML 2026] NITP: Next Implicit Token Prediction for LLM Pre-training☆33May 26, 2026Updated last month
- ☆25Jun 10, 2025Updated last year
- Code repository for the ICML 2026 Oral paper "Characterizing, Evaluating, and Optimizing Complex Reasoning".☆17Jun 21, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Training tiny models to prove hard theorems☆81Mar 5, 2026Updated 4 months ago
- This repository includes code for our paper: ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning…☆15May 2, 2026Updated 2 months ago
- Official code for "Self-Distilled Agentic Reinforcement Learning"☆299Updated this week
- GFT: From Imitation to Reward Fine-Tuning with Unbiased Group Advantages and Dynamic Coefficient Rectification☆37Jun 10, 2026Updated last month
- ☆66May 12, 2026Updated 2 months ago
- [ICML'26] VideoGPA is a self-supervised framework that enhances 3D consistency in Video Diffusion Models.☆69Jun 6, 2026Updated last month
- Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"☆11Jan 10, 2025Updated last year
- ☆21May 14, 2026Updated 2 months ago
- [ICLR 2025] Language Imbalance Driven Rewarding for Multilingual Self-improving☆25Apr 6, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?☆20Mar 9, 2025Updated last year
- Respect to the input tensor instead of paramters of NN☆21Jul 18, 2022Updated 3 years ago
- [ACL 2025] The official code for "AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection".☆42Aug 4, 2025Updated 11 months ago
- Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning☆28Jul 8, 2026Updated last week
- A curated list of personalized alignment resources (continually updated).☆77Jun 2, 2026Updated last month
- Agentic RL on Any Harness at Scale☆648Updated this week
- [ACL 2026] Dissecting Failure Dynamics in Large Language Model Reasoning☆17Apr 17, 2026Updated 2 months ago
- ☆11Sep 19, 2025Updated 9 months ago
- Reproducible and flexible LLM evaluations for scientific reasoning.☆28Jul 23, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆78May 22, 2024Updated 2 years ago
- Repository for the Paper: Leave My Images Alone: Preventing Multi-Modal Large Language Models from Analyzing Images via Visual Prompt Inj…☆19Apr 17, 2026Updated 2 months ago
- Code for our ICLR 2023 paper Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examples.☆18May 31, 2023Updated 3 years ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆29Jun 4, 2024Updated 2 years ago
- Official code for Guiding Language Model Math Reasoning with Planning Tokens☆19Feb 29, 2024Updated 2 years ago
- A Teacher–Student Cooperation Framework to Synthesize Student-Consistent SFT Data☆33May 1, 2026Updated 2 months ago
- PAHF Personalized Agent from Human Feedback☆54Apr 26, 2026Updated 2 months ago