Alternatives and similar repositories for attention-feature-distillation

Users that are interested in attention-feature-distillation are comparing it to the libraries listed below

• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated last year
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆238Updated 2 years ago
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆127Updated 5 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆100Updated 3 years ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆181Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆152Updated 2 years ago
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆109Updated 5 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆101Updated last year
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆34Updated last year
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆75Updated 2 years ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆277Updated 2 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆50Updated 2 years ago
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆109Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆43Updated 3 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆34Updated 2 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆90Updated 3 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆168Updated 5 years ago
• lliai / Awesome-Vision-Knowledge-Distillation
  Awesome Knowledge-Distillation for CV
  ☆89Updated last year
• jingyang2017 / KD_SRRL
  ☆47Updated 4 years ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆81Updated 7 months ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆102Updated 5 years ago
• VainF / Data-Free-Adversarial-Distillation
  Code and pretrained models for paper: Data-Free Adversarial Distillation
  ☆99Updated 2 years ago
• Jangho-Kim / FFL-pytorch
  Feature Fusion for Online Mutual Knowledge Distillation Code
  ☆26Updated 5 years ago
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆180Updated 11 months ago
• seominseok0429 / label-smoothing-visualization-pytorch
  When Does Label Smoothing Help?_pytorch_implementationimp
  ☆126Updated 5 years ago
• dvlab-research / MiSLAS
  Improving Calibration for Long-Tailed Recognition (CVPR2021)
  ☆150Updated 4 years ago
• alexrame / mixmo-pytorch
  Official Pytorch implementation of MixMo framework
  ☆84Updated 4 years ago
• changlin31 / DS-Net
  (CVPR 2021, Oral) Dynamic Slimmable Network
  ☆229Updated 3 years ago
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆584Updated 2 years ago
• LTH14 / FSKD
  ☆31Updated 5 years ago