Alternatives and similar repositories for torchdistill

Users that are interested in torchdistill are comparing it to the libraries listed below

• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,721Updated 3 years ago
• SforAiDl / KD_Lib
  A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…
  ☆646Updated 2 years ago
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,382Updated 2 years ago
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,923Updated last year
• microsoft / Cream
  This is a collection of our NAS and Vision Transformer work.
  ☆1,805Updated last year
• haitongli / knowledge-distillation-pytorch
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,966Updated 2 years ago
• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,631Updated 2 years ago
• snap-research / EfficientFormer
  EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]
  ☆1,081Updated 2 years ago
• facebookresearch / fvcore
  Collection of common code that's shared among different research projects in FAIR computer vision team.
  ☆2,189Updated last month
• VainF / Torch-Pruning
  [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
  ☆3,151Updated last month
• megvii-research / mdistiller
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆873Updated last year
• sail-sg / poolformer
  PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
  ☆1,355Updated last year
• SHI-Labs / Compact-Transformers
  Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)
  ☆536Updated 11 months ago
• huawei-noah / Efficient-Computing
  Efficient computing methods developed by Huawei Noah's Ark Lab
  ☆1,296Updated 11 months ago
• he-y / Awesome-Pruning
  A curated list of neural network pruning resources.
  ☆2,477Updated last year
• google-research / sam
  ☆605Updated last month
• xxxnell / how-do-vits-work
  (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"
  ☆819Updated 3 years ago
• open-mmlab / mmrazor
  OpenMMLab Model Compression Toolbox and Benchmark.
  ☆1,632Updated last year
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,077Updated 2 years ago
• Alibaba-MIIL / ImageNet21K
  Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper
  ☆774Updated 2 years ago
• jacobgil / vit-explain
  Explainability for Vision Transformers
  ☆1,009Updated 3 years ago
• facebookresearch / deit
  Official DeiT repository
  ☆4,271Updated last year
• apple / ml-cvnets
  CVNets: A library for training computer vision networks
  ☆1,916Updated last year
• facebookresearch / pycls
  Codebase for Image Classification Research, written in PyTorch.
  ☆2,165Updated last year
• jeonsworld / ViT-pytorch
  Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆2,084Updated 3 years ago
• lhyfst / knowledge-distillation-papers
  knowledge distillation papers
  ☆762Updated 2 years ago
• Westlake-AI / openmixup
  CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
  ☆657Updated last month
• facebookresearch / moco-v3
  PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057
  ☆1,298Updated 3 years ago
• sail-sg / Adan
  Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  ☆799Updated 4 months ago
• mit-han-lab / once-for-all
  [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
  ☆1,930Updated last year