Alternatives and similar repositories for torchdistill

Users that are interested in torchdistill are comparing it to the libraries listed below

• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,694Updated 3 years ago
• haitongli / knowledge-distillation-pytorch
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,939Updated 2 years ago
• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,591Updated 2 years ago
• megvii-research / mdistiller
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆855Updated last year
• SforAiDl / KD_Lib
  A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…
  ☆630Updated 2 years ago
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,336Updated last year
• microsoft / Cream
  This is a collection of our NAS and Vision Transformer work.
  ☆1,759Updated 10 months ago
• facebookresearch / moco-v3
  PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057
  ☆1,269Updated 3 years ago
• facebookresearch / fvcore
  Collection of common code that's shared among different research projects in FAIR computer vision team.
  ☆2,130Updated 6 months ago
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,874Updated last year
• VainF / Torch-Pruning
  [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
  ☆3,017Updated last month
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆585Updated 2 years ago
• sail-sg / poolformer
  PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
  ☆1,333Updated 11 months ago
• dkozlov / awesome-knowledge-distillation
  Awesome Knowledge Distillation
  ☆3,679Updated last week
• he-y / Awesome-Pruning
  A curated list of neural network pruning resources.
  ☆2,449Updated last year
• facebookresearch / vissl
  VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
  ☆3,284Updated last year
• facebookresearch / deit
  Official DeiT repository
  ☆4,205Updated last year
• hila-chefer / Transformer-Explainability
  [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize …
  ☆1,887Updated last year
• snap-research / EfficientFormer
  EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]
  ☆1,049Updated last year
• HobbitLong / PyContrast
  PyTorch implementation of Contrastive Learning methods
  ☆1,983Updated last year
• open-mmlab / mmrazor
  OpenMMLab Model Compression Toolbox and Benchmark.
  ☆1,600Updated 11 months ago
• lucidrains / byol-pytorch
  Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
  ☆1,822Updated 10 months ago
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,072Updated 2 years ago
• clovaai / CutMix-PyTorch
  Official Pytorch implementation of CutMix regularizer
  ☆1,239Updated 4 years ago
• lucidrains / mlp-mixer-pytorch
  An All-MLP solution for Vision, from Google AI
  ☆1,022Updated 8 months ago
• yitu-opensource / T2T-ViT
  ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
  ☆1,188Updated last year
• jeonsworld / ViT-pytorch
  Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆2,036Updated 2 years ago
• apple / ml-cvnets
  CVNets: A library for training computer vision networks
  ☆1,872Updated last year
• facebookresearch / simsiam
  PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566
  ☆1,194Updated 2 years ago
• CoinCheung / pytorch-loss
  label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful
  ☆2,241Updated 7 months ago