clovaai / overhaul-distillation
Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)
☆416Updated 4 years ago
Alternatives and similar repositories for overhaul-distillation:
Users that are interested in overhaul-distillation are comparing it to the libraries listed below
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆585Updated 2 years ago
- Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019☆395Updated 3 years ago
- [ECCV2020] Knowledge Distillation Meets Self-Supervision☆236Updated 2 years ago
- MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.☆697Updated 3 years ago
- CVPR 2020 oral paper: Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmax.☆353Updated 2 years ago
- Using Teacher Assistants to Improve Knowledge Distillation: https://arxiv.org/pdf/1902.03393.pdf☆257Updated 5 years ago
- MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning. In ICCV 2019.☆354Updated 4 years ago
- Implementation of DropBlock: A regularization method for convolutional networks in PyTorch.☆592Updated 4 years ago
- (ECCV'2020 Oral)EagleEye: Fast Sub-net Evaluation for Efficient Neural Network Pruning☆306Updated 2 years ago
- Distilling Knowledge via Knowledge Review, CVPR 2021☆266Updated 2 years ago
- ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (ICCV 2021)☆294Updated 2 years ago
- The official code for the paper 'Structured Knowledge Distillation for Semantic Segmentation'. (CVPR 2019 ORAL) and extension to other ta…☆718Updated 4 years ago
- Slimmable Networks, AutoSlim, and Beyond, ICLR 2019, and ICCV 2019☆917Updated 2 years ago
- Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks☆379Updated 5 years ago
- Network Slimming (Pytorch) (ICCV 2017)☆916Updated 4 years ago
- PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models☆293Updated 4 years ago
- Fast Neural Network Adaptation via Parameter Remapping and Architecture Search (ICLR2020 & TPAMI)☆166Updated 3 years ago
- 🛠 Toolbox to extend PyTorch functionalities☆419Updated 10 months ago
- PyTorch implementation of AutoAugment.☆158Updated 4 years ago
- Official implementation of 'FMix: Enhancing Mixed Sample Data Augmentation'☆334Updated 3 years ago
- Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)☆117Updated 4 years ago
- Learning Efficient Convolutional Networks through Network Slimming, In ICCV 2017.☆568Updated 5 years ago
- Unofficial PyTorch Reimplementation of RandAugment.☆631Updated 2 years ago
- Pruning Neural Networks with Taylor criterion in Pytorch☆315Updated 5 years ago
- ☆262Updated 5 years ago
- Try out different pruning-approaches on lightweight Backbones.☆146Updated 4 years ago
- ☆286Updated 4 years ago
- An extension version of our paper accepted by CVPR 2020, Oral -- HRank: Filter Pruning using High-Rank Feature Map☆148Updated 3 years ago
- [ICLR 2020]: 'AtomNAS: Fine-Grained End-to-End Neural Architecture Search'☆222Updated 4 years ago
- Code for the NuerIPS'19 paper "Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks"☆196Updated 5 years ago