Alternatives and similar repositories for Vision-Transformer

Users that are interested in Vision-Transformer are comparing it to the libraries listed below

• pprp / PyTorch-CIFAR-Model-Hub
  Implementation of Conv-based and Vit-based networks designed for CIFAR.
  ☆71Updated 2 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆98Updated last year
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 9 months ago
• jianghaojun / CondenseNetV2
  [CVPR 2021] CondenseNet V2: Sparse Feature Reactivation for Deep Networks
  ☆85Updated 2 years ago
• JoonyoungYi / KD-pytorch
  PyTorch implementation of "Distilling the Knowledge in a Neural Network"
  ☆67Updated 3 years ago
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆236Updated 2 years ago
• yxgeee / BAKE
  Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification
  ☆82Updated 3 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆33Updated last year
• FreeformRobotics / Divide-and-Co-training
  [TIP 2022] Towards Better Accuracy-efficiency Trade-offs: Divide and Co-training. Plus, an image classification toolbox includes ResNet, …
  ☆104Updated 2 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆166Updated 4 years ago
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆32Updated 9 months ago
• alexrame / mixmo-pytorch
  Official Pytorch implementation of MixMo framework
  ☆84Updated 3 years ago
• VITA-Group / Nasty-Teacher
  [ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Che…
  ☆81Updated 3 years ago
• manoja328 / rodeo
  Official implementation of "RODEO: Replay for Online Object Detection", BMVC 2020
  ☆27Updated 3 years ago
• Cydia2018 / Vision-Transformer-CIFAR10
  Pytorch implementation of some vision transformers, trained on CIFAR-10.
  ☆29Updated 3 years ago
• wangleiofficial / label-smoothing-pytorch
  label smoothing PyTorch implementation
  ☆32Updated 4 years ago
• zhangchbin / OnlineLabelSmoothing
  The official code for the paper "Delving Deep into Label Smoothing", IEEE TIP 2021
  ☆80Updated 2 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• VITA-Group / Random_Pruning
  [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…
  ☆73Updated 2 years ago
• bellymonster / Weighted-Soft-Label-Distillation
  ☆57Updated 3 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆117Updated 4 years ago
• ososos888 / prune-then-distill
  ☆47Updated 2 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆188Updated last year
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆107Updated 4 years ago
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆106Updated 2 years ago
• ArchipLab-LinfengZhang / Task-Oriented-Feature-Distillation
  This is the implementaion of paper "Task-Oriented Feature Distillation"
  ☆43Updated 3 years ago
• LTH14 / FSKD
  ☆30Updated 4 years ago
• zju-vipa / spot-adaptive-pytorch
  ☆24Updated 3 years ago