haitongli / knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
☆1,864Updated last year
Related projects ⓘ
Alternatives and complementary repositories for knowledge-distillation-pytorch
- Pytorch implementation of various Knowledge Distillation (KD) methods.☆1,614Updated 2 years ago
- Awesome Knowledge Distillation☆3,479Updated last month
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,497Updated last year
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,197Updated last year
- knowledge distillation papers☆741Updated last year
- Flops counter for convolutional networks in pytorch framework☆2,822Updated last month
- mixup: Beyond Empirical Risk Minimization☆1,168Updated 3 years ago
- Count the MACs / FLOPs of your PyTorch model.☆4,888Updated 4 months ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆580Updated last year
- A curated list of neural network pruning resources.☆2,361Updated 7 months ago
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,183Updated last month
- Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)☆1,510Updated 4 years ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆25 knowledge distillation methods presented at CVPR, I…☆1,392Updated last month
- Model analyzer in PyTorch☆1,468Updated last year
- Classification with PyTorch.☆1,693Updated 5 months ago
- My best practice of training large dataset using PyTorch.☆1,086Updated 6 months ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆977Updated last month
- Improving Convolutional Networks via Attention Transfer (ICLR 2017)☆1,444Updated 6 years ago
- Official Pytorch implementation of CutMix regularizer☆1,221Updated 4 years ago
- Codebase for Image Classification Research, written in PyTorch.☆2,139Updated 8 months ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…☆608Updated last year
- Collection of recent methods on (deep) neural network compression and acceleration.☆930Updated 2 months ago
- ☆662Updated 3 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆807Updated last year
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,884Updated 11 months ago
- Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow☆1,466Updated last year
- experiments on Paper <Bag of Tricks for Image Classification with Convolutional Neural Networks> and other useful tricks to improve CNN a…☆716Updated 5 years ago
- Slimmable Networks, AutoSlim, and Beyond, ICLR 2019, and ICCV 2019☆911Updated last year
- PyTorch implementation of Contrastive Learning methods☆1,942Updated last year
- PyTorch DataLoaders implemented with DALI for accelerating image preprocessing☆880Updated 4 years ago