bhheo / AB_distillation
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)
☆104Updated 5 years ago
Alternatives and similar repositories for AB_distillation:
Users that are interested in AB_distillation are comparing it to the libraries listed below
- Knowledge Distillation with Adversarial Samples Supporting Decision Boundary (AAAI 2019)☆70Updated 5 years ago
- ☆49Updated 5 years ago
- Pytorch implementation of SNAS☆75Updated 6 years ago
- Official Implementation of MEAL: Multi-Model Ensemble via Adversarial Learning on AAAI 2019☆177Updated 5 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆48Updated 5 years ago
- Learning Metrics from Teachers: Compact Networks for Image Embedding (CVPR19)☆76Updated 5 years ago
- PyTorch implementation of "Single-Path NAS: Device-Aware Efficient ConvNet Design"☆36Updated 2 years ago
- [ICLR 2020]: 'AtomNAS: Fine-Grained End-to-End Neural Architecture Search'☆222Updated 4 years ago
- Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)☆264Updated 5 years ago
- Codes of Centripetal SGD☆63Updated 2 years ago
- Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search☆89Updated 5 years ago
- Using Teacher Assistants to Improve Knowledge Distillation: https://arxiv.org/pdf/1902.03393.pdf☆256Updated 5 years ago
- ☆134Updated 6 years ago
- BlockDrop: Dynamic Inference Paths in Residual Networks☆142Updated 2 years ago
- PyTorch implementation Large-Margin Softmax (L-Softmax) loss☆100Updated 6 years ago
- ☆182Updated last year
- Implementation with latest PyTorch (v1.1) for multi-gpu DARTS https://arxiv.org/abs/1806.09055☆83Updated 5 years ago
- A PyTorch implementation of shake-shake☆111Updated 4 years ago
- PyTorch implementation of Dynamic Grouping Convolution and Groupable ConvNet with pre-trained G-ResNeXt models☆69Updated 4 years ago
- Pytorch implementation of group normalization in https://arxiv.org/abs/1803.08494 (Following the PyTorch Style)☆87Updated 6 years ago
- Tools for computing model parameters and FLOPs.☆86Updated 6 years ago
- Neural architecture search(NAS)☆14Updated 5 years ago
- PyTorch implementation for GAL.☆55Updated 4 years ago
- Some projects from Xuanyi Dong.☆90Updated 5 months ago
- Zero-Shot Knowledge Distillation in Deep Networks☆64Updated 2 years ago
- Official repository for Big-Little Net☆58Updated 5 years ago
- Efficient HetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNs☆41Updated 5 years ago
- ☆87Updated 6 years ago
- Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization at CVPR'19☆48Updated 5 years ago
- My implementation of RePr training scheme in PyTorch. https://arxiv.org/pdf/1811.07275.pdf☆71Updated 5 years ago