Alternatives and similar repositories for attention-feature-distillation

Users that are interested in attention-feature-distillation are comparing it to the libraries listed below

• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated last year
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆127Updated 5 years ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆180Updated 3 years ago
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆237Updated 3 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆100Updated 3 years ago
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆109Updated 5 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆101Updated last year
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆154Updated 2 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆34Updated 2 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆89Updated 3 years ago
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆75Updated 2 years ago
• dvlab-research / ReviewKD
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆277Updated 3 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆168Updated 5 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆50Updated 3 years ago
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆110Updated 3 years ago
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆34Updated last year
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆43Updated 3 years ago
• sseung0703 / Variational_Information_Distillation
  Reproducing VID in CVPR2019 (on working)
  ☆20Updated 6 years ago
• seominseok0429 / label-smoothing-visualization-pytorch
  When Does Label Smoothing Help?_pytorch_implementationimp
  ☆126Updated 5 years ago
• VainF / Data-Free-Adversarial-Distillation
  Code and pretrained models for paper: Data-Free Adversarial Distillation
  ☆99Updated 3 years ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆102Updated 5 years ago
• dvlab-research / MiSLAS
  Improving Calibration for Long-Tailed Recognition (CVPR2021)
  ☆153Updated 4 years ago
• zhangchbin / OnlineLabelSmoothing
  The official code for the paper "Delving Deep into Label Smoothing", IEEE TIP 2021
  ☆81Updated 3 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆65Updated 4 years ago
• yuanli2333 / Teacher-free-Knowledge-Distillation
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆585Updated 2 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆189Updated last year
• yxgeee / BAKE
  Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification
  ☆82Updated 4 years ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆81Updated 9 months ago
• VICO-UoE / KD4MTL
  Knowledge Distillation for Multi-task Learning (ECCV20 Workshops)
  ☆78Updated 2 years ago
• changlin31 / DS-Net
  (CVPR 2021, Oral) Dynamic Slimmable Network
  ☆231Updated 3 years ago