Alternatives and similar repositories for attention-feature-distillation:

Users that are interested in attention-feature-distillation are comparing it to the libraries listed below

• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆107Updated 4 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 8 months ago
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆236Updated 2 years ago
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆124Updated 4 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆98Updated 11 months ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆269Updated 2 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆93Updated 2 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆33Updated last year
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆74Updated last year
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆106Updated 2 years ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆175Updated 3 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆86Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆143Updated 2 years ago
• szq0214 / Un-Mix
  Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning.
  ☆151Updated 2 years ago
• lenscloth / RKD
  Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
  ☆396Updated 3 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆186Updated 11 months ago
• yangle15 / RANet-pytorch
  Resolution adaptive network
  ☆151Updated 2 years ago
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆587Updated 2 years ago
• seominseok0429 / label-smoothing-visualization-pytorch
  When Does Label Smoothing Help?_pytorch_implementationimp
  ☆125Updated 5 years ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆100Updated 4 years ago
• yxgeee / BAKE
  Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification
  ☆82Updated 3 years ago
• sseung0703 / Variational_Information_Distillation
  Reproducing VID in CVPR2019 (on working)
  ☆20Updated 5 years ago
• ArchipLab-LinfengZhang / Task-Oriented-Feature-Distillation
  This is the implementaion of paper "Task-Oriented Feature Distillation"
  ☆43Updated 3 years ago
• dingmyu / HR-NAS
  HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers (CVPR21 Oral)
  ☆141Updated 3 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆167Updated 4 years ago
• changlin31 / DS-Net
  (CVPR 2021, Oral) Dynamic Slimmable Network
  ☆229Updated 3 years ago
• dvlab-research / MiSLAS
  Improving Calibration for Long-Tailed Recognition (CVPR2021)
  ☆147Updated 3 years ago