Alternatives and similar repositories for mdistiller

Users that are interested in mdistiller are comparing it to the libraries listed below

• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆277Updated 3 years ago
• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,734Updated 4 years ago
• open-mmlab / mmrazor
  OpenMMLab Model Compression Toolbox and Benchmark.
  ☆1,651Updated last year
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,414Updated 2 years ago
• yzd-v / cls_KD
  'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
  ☆240Updated 2 years ago
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆181Updated last year
• Westlake-AI / openmixup
  CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
  ☆658Updated 2 months ago
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆585Updated 2 years ago
• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,643Updated 2 years ago
• huawei-noah / Efficient-Computing
  Efficient computing methods developed by Huawei Noah's Ark Lab
  ☆1,303Updated last year
• raoyongming / DynamicViT
  [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
  ☆641Updated 2 years ago
• yzd-v / MGD
  Masked Generative Distillation (ECCV 2022)
  ☆235Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆154Updated 2 years ago
• open-mmlab / awesome-vit
  ☆429Updated 3 years ago
• lhyfst / knowledge-distillation-papers
  knowledge distillation papers
  ☆766Updated 2 years ago
• yzd-v / FGD
  Focal and Global Knowledge Distillation for Detectors (CVPR 2022)
  ☆382Updated 3 years ago
• alibaba / lightweight-neural-architecture-search
  This is a collection of our zero-cost NAS and efficient vision applications.
  ☆446Updated 2 years ago
• yoshitomo-matsubara / torchdistill
  A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods p…
  ☆1,577Updated last month
• shaoeric / Peer-Collaborative-Learning-for-Online-Knowledge-Distillation
  Pytorch reproduction of Peer Collaborative Learning for Online Knowledge Distillation, AAAI2021
  ☆21Updated 3 years ago
• zgcr / SimpleAICV_pytorch_training_examples
  SimpleAICV:pytorch training and testing examples.
  ☆437Updated last month
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆127Updated 5 years ago
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆133Updated last year
• microsoft / Cream
  This is a collection of our NAS and Vision Transformer work.
  ☆1,812Updated last year
• DingXiaoH / RepLKNet-pytorch
  Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs (CVPR 2022)
  ☆933Updated last year
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆180Updated 3 years ago
• WeiHongLee / Awesome-Multi-Task-Learning
  An up-to-date list of works on Multi-Task Learning
  ☆375Updated 2 months ago
• murufeng / awesome_lightweight_networks
  The implementation of various lightweight networks by using PyTorch. such as：MobileNetV2，MobileNeXt，GhostNet，ParNet，MobileViT、AdderNet，Sh…
  ☆904Updated 3 years ago
• kaijieshi7 / Dynamic-convolution-Pytorch
  Pytorch!!!Pytorch!!!Pytorch!!! Dynamic Convolution: Attention over Convolution Kernels (CVPR-2020)
  ☆594Updated 3 years ago
• zihangJiang / TokenLabeling
  Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"
  ☆432Updated 2 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆100Updated 3 years ago