AberHu / Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
☆1,672Updated 3 years ago
Alternatives and similar repositories for Knowledge-Distillation-Zoo:
Users that are interested in Knowledge-Distillation-Zoo are comparing it to the libraries listed below
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,559Updated last year
- A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility☆1,918Updated last year
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,290Updated last year
- knowledge distillation papers☆752Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆840Updated last year
- Awesome Knowledge Distillation☆3,611Updated last week
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…☆1,467Updated last week
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆585Updated 2 years ago
- A curated list of neural network pruning resources.☆2,426Updated 11 months ago
- A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…☆619Updated 2 years ago
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,223Updated 5 months ago
- PyTorch implementation of Contrastive Learning methods☆1,966Updated last year
- Codebase for Image Classification Research, written in PyTorch.☆2,150Updated last year
- Flops counter for convolutional networks in pytorch framework☆2,868Updated 2 months ago
- My best practice of training large dataset using PyTorch.☆1,092Updated 10 months ago
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,559Updated 9 months ago
- experiments on Paper <Bag of Tricks for Image Classification with Convolutional Neural Networks> and other useful tricks to improve CNN a…☆724Updated 6 years ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆939Updated 3 months ago
- PyTorch implementation of multi-task learning architectures, incl. MTI-Net (ECCV2020).☆796Updated 3 years ago
- ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet☆1,180Updated last year
- Efficient computing methods developed by Huawei Noah's Ark Lab☆1,254Updated 4 months ago
- A quickstart and benchmark for pytorch distributed training.☆1,655Updated 7 months ago
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆988Updated 5 months ago
- Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)☆417Updated 4 years ago
- Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)☆2,008Updated 2 years ago
- Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019☆395Updated 3 years ago
- Proper implementation of ResNet-s for CIFAR10/100 in pytorch that matches description of the original paper.☆1,263Updated 9 months ago
- Official Pytorch implementation of CutMix regularizer☆1,228Updated 4 years ago
- mixup: Beyond Empirical Risk Minimization☆1,177Updated 3 years ago
- The official code for the paper 'Structured Knowledge Distillation for Semantic Segmentation'. (CVPR 2019 ORAL) and extension to other ta…☆719Updated 4 years ago