Alternatives and similar repositories for torchdistill

Users that are interested in torchdistill are comparing it to the libraries listed below

• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,714Updated 3 years ago
• SforAiDl / KD_Lib
  A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…
  ☆644Updated 2 years ago
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,372Updated last year
• haitongli / knowledge-distillation-pytorch
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,963Updated 2 years ago
• microsoft / Cream
  This is a collection of our NAS and Vision Transformer work.
  ☆1,801Updated last year
• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,625Updated 2 years ago
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,912Updated last year
• megvii-research / mdistiller
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆869Updated last year
• facebookresearch / fvcore
  Collection of common code that's shared among different research projects in FAIR computer vision team.
  ☆2,175Updated 2 weeks ago
• he-y / Awesome-Pruning
  A curated list of neural network pruning resources.
  ☆2,476Updated last year
• snap-research / EfficientFormer
  EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]
  ☆1,072Updated 2 years ago
• VainF / Torch-Pruning
  [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
  ☆3,127Updated last week
• open-mmlab / mmrazor
  OpenMMLab Model Compression Toolbox and Benchmark.
  ☆1,626Updated last year
• sail-sg / poolformer
  PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
  ☆1,352Updated last year
• SHI-Labs / Compact-Transformers
  Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)
  ☆535Updated 10 months ago
• huawei-noah / Efficient-Computing
  Efficient computing methods developed by Huawei Noah's Ark Lab
  ☆1,293Updated 10 months ago
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,077Updated 2 years ago
• xxxnell / how-do-vits-work
  (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
  ☆821Updated 3 years ago
• apple / ml-cvnets
  CVNets: A library for training computer vision networks
  ☆1,914Updated last year
• facebookresearch / moco-v3
  PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057
  ☆1,286Updated 3 years ago
• lucidrains / byol-pytorch
  Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
  ☆1,837Updated last year
• jacobgil / vit-explain
  Explainability for Vision Transformers
  ☆1,002Updated 3 years ago
• mit-han-lab / once-for-all
  [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
  ☆1,928Updated last year
• facebookresearch / pycls
  Codebase for Image Classification Research, written in PyTorch.
  ☆2,163Updated last year
• vturrisi / solo-learn
  solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
  ☆1,508Updated 2 weeks ago
• jeonsworld / ViT-pytorch
  Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆2,073Updated 3 years ago
• Westlake-AI / openmixup
  CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
  ☆658Updated 3 weeks ago
• facebookresearch / deit
  Official DeiT repository
  ☆4,259Updated last year
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆584Updated 2 years ago
• lucidrains / mlp-mixer-pytorch
  An All-MLP solution for Vision, from Google AI
  ☆1,039Updated 2 months ago