Alternatives and similar repositories for attention-feature-distillation:

Users that are interested in attention-feature-distillation are comparing it to the libraries listed below

• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆74Updated 6 months ago
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆236Updated 2 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆92Updated 2 years ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆266Updated 2 years ago
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆125Updated 4 years ago
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆107Updated 4 years ago
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆72Updated last year
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆169Updated 3 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆97Updated 9 months ago
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆102Updated 2 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆33Updated last year
• dvlab-research / MiSLAS
  Improving Calibration for Long-Tailed Recognition (CVPR2021)
  ☆146Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆140Updated 2 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆83Updated 2 years ago
• VainF / Data-Free-Adversarial-Distillation
  Code and pretrained models for paper: Data-Free Adversarial Distillation
  ☆95Updated 2 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆47Updated 2 years ago
• Jangho-Kim / Factor-Transfer-pytorch
  Paraphrasing Complex Network: Network Compression via Factor Transfer Code (NeurIPS 2018)
  ☆20Updated 4 years ago
• szq0214 / Un-Mix
  Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning.
  ☆150Updated 2 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆184Updated 9 months ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆63Updated 3 years ago
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆584Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆41Updated 2 years ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆100Updated 4 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆163Updated 4 years ago
• yxgeee / BAKE
  Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification
  ☆82Updated 3 years ago
• bellymonster / Weighted-Soft-Label-Distillation
  ☆57Updated 3 years ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆74Updated 2 months ago
• LTH14 / FSKD
  ☆30Updated 4 years ago
• lliai / Awesome-Vision-Knowledge-Distillation
  Awesome Knowledge-Distillation for CV
  ☆73Updated 9 months ago
• yellowtownhz / IE-KD
  ☆9Updated 3 years ago