Alternatives and similar repositories for torchdistill

Users that are interested in torchdistill are comparing it to the libraries listed below

• SforAiDl / KD_Lib
  A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…
  ☆647Updated 2 years ago
• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,727Updated 3 years ago
• microsoft / Cream
  This is a collection of our NAS and Vision Transformer work.
  ☆1,807Updated last year
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,934Updated last year
• haitongli / knowledge-distillation-pytorch
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,970Updated 2 years ago
• snap-research / EfficientFormer
  EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]
  ☆1,086Updated 2 years ago
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,392Updated 2 years ago
• sail-sg / poolformer
  PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
  ☆1,354Updated last year
• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,635Updated 2 years ago
• megvii-research / mdistiller
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆876Updated 2 years ago
• facebookresearch / fvcore
  Collection of common code that's shared among different research projects in FAIR computer vision team.
  ☆2,194Updated 2 months ago
• mit-han-lab / once-for-all
  [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
  ☆1,937Updated last year
• he-y / Awesome-Pruning
  A curated list of neural network pruning resources.
  ☆2,481Updated last year
• xxxnell / how-do-vits-work
  (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
  ☆818Updated 3 years ago
• SHI-Labs / Compact-Transformers
  Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)
  ☆536Updated last year
• open-mmlab / mmrazor
  OpenMMLab Model Compression Toolbox and Benchmark.
  ☆1,640Updated last year
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,077Updated 3 years ago
• lucidrains / mlp-mixer-pytorch
  An All-MLP solution for Vision, from Google AI
  ☆1,050Updated 4 months ago
• huawei-noah / Efficient-Computing
  Efficient computing methods developed by Huawei Noah's Ark Lab
  ☆1,299Updated last year
• apple / ml-cvnets
  CVNets: A library for training computer vision networks
  ☆1,926Updated 2 years ago
• facebookresearch / deit
  Official DeiT repository
  ☆4,277Updated last year
• google-research / sam
  ☆607Updated 2 months ago
• jacobgil / vit-explain
  Explainability for Vision Transformers
  ☆1,014Updated 3 years ago
• facebookresearch / moco-v3
  PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057
  ☆1,306Updated 3 years ago
• Alibaba-MIIL / ImageNet21K
  Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper
  ☆776Updated 2 years ago
• VainF / Torch-Pruning
  [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
  ☆3,175Updated 2 months ago
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆584Updated 2 years ago
• jeonsworld / ViT-pytorch
  Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆2,091Updated 3 years ago
• vturrisi / solo-learn
  solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
  ☆1,526Updated 3 weeks ago
• yitu-opensource / T2T-ViT
  ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
  ☆1,188Updated 2 years ago