AberHu / Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
☆1,683Updated 3 years ago
Alternatives and similar repositories for Knowledge-Distillation-Zoo:
Users that are interested in Knowledge-Distillation-Zoo are comparing it to the libraries listed below
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,573Updated last year
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,926Updated 2 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,316Updated last year
- Awesome Knowledge Distillation☆3,648Updated last month
- knowledge distillation papers☆753Updated 2 years ago
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…☆1,488Updated last month
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆847Updated last year
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆587Updated 2 years ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…☆624Updated 2 years ago
- A curated list of neural network pruning resources.☆2,437Updated last year
- A quickstart and benchmark for pytorch distributed training.☆1,662Updated 8 months ago
- Flops counter for neural networks in pytorch framework☆2,886Updated 3 months ago
- PyTorch implementation of Contrastive Learning methods☆1,974Updated last year
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,233Updated 6 months ago
- mixup: Beyond Empirical Risk Minimization☆1,178Updated 3 years ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆988Updated 6 months ago
- My best practice of training large dataset using PyTorch.☆1,097Updated 11 months ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)☆417Updated 4 years ago
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,580Updated 10 months ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆945Updated 2 weeks ago
- Count the MACs / FLOPs of your PyTorch model.☆4,980Updated 9 months ago
- experiments on Paper <Bag of Tricks for Image Classification with Convolutional Neural Networks> and other useful tricks to improve CNN a…☆727Updated 6 years ago
- Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)☆1,515Updated 4 years ago
- OpenMMLab Self-Supervised Learning Toolbox and Benchmark☆3,252Updated last year
- Network Slimming (Pytorch) (ICCV 2017)☆915Updated 4 years ago
- Some tricks of pytorch...☆1,187Updated 10 months ago
- Model analyzer in PyTorch☆1,482Updated 2 years ago
- PyTorch DataLoaders implemented with DALI for accelerating image preprocessing☆881Updated 4 years ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.☆2,112Updated 4 months ago
- Distilling Knowledge via Knowledge Review, CVPR 2021☆269Updated 2 years ago