Alternatives and similar repositories for torchdistill:

Users that are interested in torchdistill are comparing it to the libraries listed below

• AberHu / Knowledge-Distillation-Zoo
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,686Updated 3 years ago
• SforAiDl / KD_Lib
  A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quan…
  ☆625Updated 2 years ago
• FLHonker / Awesome-Knowledge-Distillation
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,580Updated last year
• megvii-research / mdistiller
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆853Updated last year
• HobbitLong / RepDistiller
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,325Updated last year
• haitongli / knowledge-distillation-pytorch
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,932Updated 2 years ago
• microsoft / Cream
  This is a collection of our NAS and Vision Transformer work.
  ☆1,751Updated 9 months ago
• he-y / Awesome-Pruning
  A curated list of neural network pruning resources.
  ☆2,437Updated last year
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,867Updated last year
• facebookresearch / fvcore
  Collection of common code that's shared among different research projects in FAIR computer vision team.
  ☆2,125Updated 5 months ago
• VainF / Torch-Pruning
  [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.
  ☆2,994Updated 2 weeks ago
• snap-research / EfficientFormer
  EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]
  ☆1,041Updated last year
• sail-sg / poolformer
  PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
  ☆1,325Updated 11 months ago
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,071Updated 2 years ago
• open-mmlab / mmrazor
  OpenMMLab Model Compression Toolbox and Benchmark.
  ☆1,586Updated 10 months ago
• hila-chefer / Transformer-Explainability
  [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize …
  ☆1,879Updated last year
• huawei-noah / Efficient-Computing
  Efficient computing methods developed by Huawei Noah's Ark Lab
  ☆1,265Updated 6 months ago
• facebookresearch / ConvNeXt-V2
  Code release for ConvNeXt V2 model
  ☆1,719Updated 8 months ago
• The-AI-Summer / self-attention-cv
  Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
  ☆1,205Updated 3 years ago
• jacobgil / vit-explain
  Explainability for Vision Transformers
  ☆949Updated 3 years ago
• lucidrains / mlp-mixer-pytorch
  An All-MLP solution for Vision, from Google AI
  ☆1,021Updated 7 months ago
• facebookresearch / deit
  Official DeiT repository
  ☆4,190Updated last year
• jeonsworld / ViT-pytorch
  Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆2,026Updated 2 years ago
• Alibaba-MIIL / ImageNet21K
  Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper
  ☆762Updated 2 years ago
• alibaba / lightweight-neural-architecture-search
  This is a collection of our zero-cost NAS and efficient vision applications.
  ☆417Updated last year
• facebookresearch / pycls
  Codebase for Image Classification Research, written in PyTorch.
  ☆2,153Updated last year
• Westlake-AI / openmixup
  CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
  ☆650Updated 3 weeks ago
• SHI-Labs / Compact-Transformers
  Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)
  ☆526Updated 6 months ago
• facebookresearch / vissl
  VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
  ☆3,281Updated last year
• sail-sg / Adan
  Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  ☆789Updated 10 months ago