haitongli / knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
☆1,924Updated 2 years ago
Alternatives and similar repositories for knowledge-distillation-pytorch:
Users that are interested in knowledge-distillation-pytorch are comparing it to the libraries listed below
- Pytorch implementation of various Knowledge Distillation (KD) methods.☆1,677Updated 3 years ago
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,566Updated last year
- Awesome Knowledge Distillation☆3,626Updated 3 weeks ago
- knowledge distillation papers☆753Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,304Updated last year
- A curated list of neural network pruning resources.☆2,430Updated 11 months ago
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,230Updated 5 months ago
- Classification with PyTorch.☆1,724Updated 9 months ago
- Flops counter for neural networks in pytorch framework☆2,872Updated 2 months ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…☆1,475Updated last week
- Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)☆1,515Updated 4 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆586Updated 2 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆988Updated 5 months ago
- Count the MACs / FLOPs of your PyTorch model.☆4,973Updated 8 months ago
- mixup: Beyond Empirical Risk Minimization☆1,177Updated 3 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…☆621Updated 2 years ago
- Improving Convolutional Networks via Attention Transfer (ICLR 2017)☆1,453Updated 6 years ago
- Model analyzer in PyTorch☆1,480Updated 2 years ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆943Updated 4 months ago
- experiments on Paper <Bag of Tricks for Image Classification with Convolutional Neural Networks> and other useful tricks to improve CNN a…☆724Updated 6 years ago
- My best practice of training large dataset using PyTorch.☆1,095Updated 10 months ago
- Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow☆1,479Updated last year
- Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.☆1,269Updated 9 months ago
- A quickstart and benchmark for pytorch distributed training.☆1,658Updated 8 months ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆842Updated last year
- Official Pytorch implementation of CutMix regularizer☆1,229Updated 4 years ago
- PyTorch DataLoaders implemented with DALI for accelerating image preprocessing☆881Updated 4 years ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)☆417Updated 4 years ago
- A PyTorch Implementation of Focal Loss.☆980Updated 5 years ago
- The official code for the paper 'Structured Knowledge Distillation for Semantic Segmentation'. (CVPR 2019 ORAL) and extension to other ta…☆721Updated 4 years ago