Alternatives and similar repositories for awesome-knowledge-distillation:

Users that are interested in awesome-knowledge-distillation are comparing it to the libraries listed below

• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,559Updated last year
• haitongli / knowledge-distillation-pytorch
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,921Updated last year
• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,672Updated 3 years ago
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,295Updated last year
• lhyfst / knowledge-distillation-papers
  knowledge distillation papers
  ☆752Updated 2 years ago
• IntelLabs / distiller
  Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…
  ☆4,376Updated last year
• he-y / Awesome-Pruning
  A curated list of neural network pruning resources.
  ☆2,426Updated 11 months ago
• Eric-mingjie / rethinking-network-pruning
  Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)
  ☆1,516Updated 4 years ago
• szagoruyko / attention-transfer
  Improving Convolutional Networks via Attention Transfer (ICLR 2017)
  ☆1,452Updated 6 years ago
• Lyken17 / pytorch-OpCounter
  Count the MACs / FLOPs of your PyTorch model.
  ☆4,964Updated 8 months ago
• MingSun-Tse / Efficient-Deep-Learning
  Collection of recent methods on (deep) neural network compression and acceleration.
  ☆939Updated 3 months ago
• sovrasov / flops-counter.pytorch
  Flops counter for convolutional networks in pytorch framework
  ☆2,869Updated 2 months ago
• Lyken17 / Efficient-PyTorch
  My best practice of training large dataset using PyTorch.
  ☆1,092Updated 10 months ago
• memoiry / Awesome-model-compression-and-acceleration
  ☆668Updated 3 years ago
• bearpaw / pytorch-classification
  Classification with PyTorch.
  ☆1,719Updated 9 months ago
• subeeshvasu / Awesome-Learning-with-Label-Noise
  A curated list of resources for Learning with Noisy Labels
  ☆2,662Updated 10 months ago
• HobbitLong / PyContrast
  PyTorch implementation of Contrastive Learning methods
  ☆1,966Updated last year
• facebookresearch / pycls
  Codebase for Image Classification Research, written in PyTorch.
  ☆2,150Updated last year
• Swall0w / torchstat
  Model analyzer in PyTorch
  ☆1,477Updated 2 years ago
• sksq96 / pytorch-summary
  Model summary in PyTorch similar to `model.summary()` in Keras
  ☆4,033Updated last year
• yoshitomo-matsubara / torchdistill
  A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods p…
  ☆1,467Updated last week
• CoinCheung / pytorch-loss
  label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful
  ☆2,223Updated 5 months ago
• jason718 / awesome-self-supervised-learning
  A curated list of awesome self-supervised methods
  ☆6,244Updated 8 months ago
• tczhangzhi / pytorch-distributed
  A quickstart and benchmark for pytorch distributed training.
  ☆1,657Updated 7 months ago
• facebookresearch / moco
  PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722
  ☆4,922Updated 3 months ago
• megvii-research / mdistiller
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆840Updated last year
• HobbitLong / CMC
  [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis
  ☆1,318Updated 4 years ago
• HobbitLong / SupContrast
  PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)
  ☆3,220Updated last year
• open-mmlab / mmselfsup
  OpenMMLab Self-Supervised Learning Toolbox and Benchmark
  ☆3,237Updated last year
• Eric-mingjie / network-slimming
  Network Slimming (Pytorch) (ICCV 2017)
  ☆916Updated 4 years ago