moskomule / distillation.pytorch
Implementation of several knowledge distillation techniques on PyTorch
☆15Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for distillation.pytorch
- ☆49Updated 5 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆49Updated 5 years ago
- Cheap distillation for convolutional neural networks.☆33Updated 6 years ago
- Implementing MixNet: Mixed Depthwise Convolutional Kernels using Pytorch☆61Updated 4 years ago
- Unofficial pytorch implementation of Born-Again Neural Networks.☆53Updated 3 years ago
- The state-of-the-art algorithms on CIFAR-10 dataset in PyTorch☆58Updated 5 years ago
- an implementation of mixup☆41Updated 4 years ago
- ☆17Updated 5 years ago
- Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)☆104Updated 5 years ago
- Knowledge Distillation with Adversarial Samples Supporting Decision Boundary (AAAI 2019)☆70Updated 5 years ago
- PyTorch implementation of shake-drop regularization☆54Updated 4 years ago
- Role-Wise Data Augmentation for Knowledge Distillation☆18Updated 2 years ago
- A PyTorch implementation for Unsupervised Data Augmentation☆23Updated 2 years ago
- Classification with PyTorch.☆23Updated 5 years ago
- Learning Metrics from Teachers: Compact Networks for Image Embedding (CVPR19)☆76Updated 5 years ago
- Official repository for Big-Little Net☆58Updated 5 years ago
- Deep Metric Transfer for Label Propagation with Limited Annotated Data☆49Updated last year
- Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)☆107Updated 4 years ago
- On the importance of single directions for generalization(Morcos et al, ICLR 2018)☆17Updated 6 years ago
- Bootstrap Your Own Latent (BYOL) pytorch implementation using DistributedDataParallel.☆28Updated last year
- DELTA: DEep Learning Transfer using Feature Map with Attention for Convolutional Networks https://arxiv.org/abs/1901.09229☆66Updated 3 years ago
- PyTorch implementation of "Single-Path NAS: Device-Aware Efficient ConvNet Design"☆36Updated 2 years ago
- Torch implementation of the paper "ShakeDrop regularization" (https://arxiv.org/abs/1802.02375).☆21Updated 6 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆37Updated 7 years ago
- Code repositoy for "AOWS: Adaptive and optimal network width search with latency constraints", CVPR 2020☆36Updated 4 years ago
- Implementations of knowledge distillation and knowledge transfer models in neural networks.☆22Updated 5 years ago
- [ICLR'20] [PyTorch] Inverted Attention Routing for Capsules☆30Updated 4 years ago
- Implementation of the Heterogeneous Knowledge Distillation using Information Flow Modeling method☆24Updated 4 years ago
- Code for the paper "Curriculum Dropout", ICCV 2017☆25Updated 6 years ago
- ☆28Updated 4 years ago