Alternatives and similar repositories for ICKD

Users that are interested in ICKD are comparing it to the libraries listed below

• adaptivetokensampling / ATS
  Adaptive Token Sampling for Efficient Vision Transformers (ECCV 2022 Oral Presentation)
  ☆104Updated last year
• ChenMnZ / CF-ViT
  (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"
  ☆105Updated 2 years ago
• ziplab / LIT
  [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"
  ☆97Updated 3 years ago
• megvii-research / LGD
  Official Implementation of the detection self-distillation framework LGD.
  ☆53Updated 3 years ago
• YifanXu74 / Evo-ViT
  Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer
  ☆73Updated 3 years ago
• hunto / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆71Updated 2 years ago
• hustvl / MSG-Transformer
  MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)
  ☆81Updated 2 years ago
• ziplab / SPViT
  [TPAMI 2024] This is the official repository for our paper: ''Pruning Self-attentions into Convolutional Layers in Single Path''.
  ☆115Updated last year
• sihaoevery / TaT
  ☆25Updated 3 years ago
• pzhren / DW-ViT
  ☆32Updated 3 years ago
• Junjun2016 / APCNet
  Adaptive Pyramid Context Network for Semantic Segmentation (APCNet CVPR'2019)
  ☆22Updated 4 years ago
• duzhixing / FRS
  Distilling Object Detectors with Feature Richness
  ☆44Updated 3 years ago
• CVMI-Lab / KDEP
  (CVPR2022) Official PyTorch Implementation of KDEP. Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-eff…
  ☆61Updated 3 years ago
• zhechen / Deformable-DETR-REGO
  ☆40Updated last year
• hunto / LightViT
  Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
  ☆140Updated 3 years ago
• damo-cv / ELSA
  The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer
  ☆115Updated 2 years ago
• MengLcool / AdaViT
  [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".
  ☆55Updated 3 years ago
• encounter1997 / DE-DETRs
  Official Implementation of DE-DETR and DELA-DETR in "Towards Data-Efficient Detection Transformers"
  ☆79Updated last year
• svip-lab / AS-MLP
  [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".
  ☆126Updated 2 years ago
• ma-xu / FCViT
  A Close Look at Spatial Modeling: From Attention to Convolution
  ☆91Updated 2 years ago
• OpenGVLab / STM-Evaluation
  ☆72Updated 6 months ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆84Updated last year
• winycg / CIRKD
  Official implementations of CIRKD: Cross-Image Relational Knowledge Distillation for Semantic Segmentation and implementations on Citysca…
  ☆197Updated 2 weeks ago
• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆75Updated last year
• IMPlus-PCALab / Research
  This repo holds the research projects of our lab.
  ☆12Updated last year
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆109Updated 2 years ago
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆45Updated 2 years ago
• pengzhiliang / G2SD
  ☆87Updated 2 years ago
• lmbxmu / SuperViT
  Official Pytorch implementation of Super Vision Transformer (IJCV)
  ☆43Updated 2 years ago
• dvlab-research / Dsig
  Deep Structured Instance Graph for Distilling Object Detectors (ICCV 2021)
  ☆36Updated 3 years ago