aryanasadianuoit / Distilling-Knowledge-via-Intermediate-Classifiers
Distilling Knowledge via Intermediate Classifiers
☆15Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for Distilling-Knowledge-via-Intermediate-Classifiers
- A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch☆48Updated last year
- [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".☆72Updated last year
- Demonstration of transfer of knowledge and generalization with distillation☆45Updated 5 years ago
- The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".☆31Updated 3 months ago
- [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.☆31Updated 4 years ago
- A generic code base for neural network pruning, especially for pruning at initialization.☆30Updated 2 years ago
- Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"☆41Updated 2 years ago
- [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".☆74Updated 3 months ago
- ☆26Updated 3 years ago
- [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…☆73Updated last year
- Graph Knowledge Distillation☆13Updated 4 years ago
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆56Updated last year
- Code for "Self-Distillation as Instance-Specific Label Smoothing"☆14Updated 4 years ago
- Feature Fusion for Online Mutual Knowledge Distillation Code☆24Updated 4 years ago
- Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)☆115Updated 3 years ago
- Pruning Filters For Efficient ConvNets, PyTorch Implementation.☆30Updated 4 years ago
- ZSKD with PyTorch☆30Updated last year
- A pytorch implement of scalable neural netowrks.☆23Updated 4 years ago
- Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch☆29Updated 3 years ago
- Auto-Prox-AAAI24☆10Updated 6 months ago
- Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 -- Distilling a Powerful Student Model via Online Knowledge Distillation☆28Updated 3 years ago
- Codes for paper "Few Shot Network Compression via Cross Distillation", AAAI 2020.☆30Updated 4 years ago
- [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…☆18Updated 2 years ago
- (NeurIPS 2019) Deep Model Transferbility from Attribution Maps☆20Updated 5 years ago
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆159Updated 2 years ago
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆68Updated last year
- ☆119Updated 4 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆46Updated last year
- Code and checkpoints of compressed networks for the paper titled "HYDRA: Pruning Adversarially Robust Neural Networks" (NeurIPS 2020) (ht…☆90Updated last year
- Implementation of Domain adaptation on PACS dataset using a modified version of Alexnet.☆21Updated 3 years ago