hunto / DIST_KDView external linksLinks
Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
☆155Dec 28, 2022Updated 3 years ago
Alternatives and similar repositories for DIST_KD
Users that are interested in DIST_KD are comparing it to the libraries listed below
Sorting:
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆87Mar 20, 2024Updated last year
- Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.☆71Apr 14, 2023Updated 2 years ago
- Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022☆37Nov 25, 2022Updated 3 years ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆243Oct 10, 2023Updated 2 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆889Nov 5, 2023Updated 2 years ago
- Masked Generative Distillation (ECCV 2022)☆240Nov 9, 2022Updated 3 years ago
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆94Jan 24, 2024Updated 2 years ago
- Distilling Knowledge via Knowledge Review, CVPR 2021☆280Dec 16, 2022Updated 3 years ago
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆102Jun 16, 2022Updated 3 years ago
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆76Nov 21, 2023Updated 2 years ago
- Code of our Neurips2020 paper "Auto Learning Attention", coming soon☆22Apr 14, 2021Updated 4 years ago
- Code for RepNAS☆14Dec 21, 2021Updated 4 years ago
- Deep Structured Instance Graph for Distilling Object Detectors (ICCV 2021)☆36Oct 17, 2021Updated 4 years ago
- [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"☆182Dec 3, 2024Updated last year
- [NeurIPS'22] Projector Ensemble Feature Distillation☆30Jan 4, 2024Updated 2 years ago
- 国内外数据竞赛资讯整理☆18Nov 6, 2021Updated 4 years ago
- Benchmarking Attention Mechanism in Vision Transformers.☆20Oct 10, 2022Updated 3 years ago
- Knowledge Distillation Toolbox for Semantic Segmentation☆17Nov 20, 2022Updated 3 years ago
- ☆28Nov 29, 2023Updated 2 years ago
- codes for ICML2021 paper iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients☆10May 27, 2021Updated 4 years ago
- Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation☆18Jul 30, 2024Updated last year
- [ECCV 2022] Implementation of the paper "Locality Guidance for Improving Vision Transformers on Tiny Datasets"☆82Jul 21, 2022Updated 3 years ago
- [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…☆110Nov 28, 2022Updated 3 years ago
- Anytime Dense Prediction with Confidence Adaptivity (ICLR 2022)☆52Aug 23, 2024Updated last year
- Distilling Object Detectors with Feature Richness☆44Apr 15, 2022Updated 3 years ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆46Jun 13, 2023Updated 2 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆585Feb 15, 2023Updated 2 years ago
- Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"☆190Apr 29, 2024Updated last year
- Focal and Global Knowledge Distillation for Detectors (CVPR 2022)☆385Sep 19, 2022Updated 3 years ago
- [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)☆34May 21, 2023Updated 2 years ago
- Official implementations of CIRKD: Cross-Image Relational Knowledge Distillation for Semantic Segmentation and implementations on Citysca…☆211Aug 29, 2025Updated 5 months ago
- ☆12May 22, 2022Updated 3 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,662Jun 11, 2024Updated last year
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆14Jun 5, 2019Updated 6 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,426Oct 16, 2023Updated 2 years ago
- Code for "Long-tail Detection with Effective Class-Margins." (ECCV 2022 Oral)☆63Sep 2, 2023Updated 2 years ago
- [CVPRW 2021] Dynamic-OFA: Runtime DNN Architecture Switching for Performance Scaling on Heterogeneous Embedded Platforms☆30Nov 9, 2022Updated 3 years ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods p…☆1,590Dec 24, 2025Updated last month