Alternatives and similar repositories for attention-feature-distillation

Users that are interested in attention-feature-distillation are comparing it to the libraries listed below

• ifding / DLKD

  View on GitHub
  Source Code for "Dual-Level Knowledge Distillation via Knowledge Alignment and Correlation", TNNLS, https://ieeexplore.ieee.org/abstract/…
  ☆12Dec 21, 2022Updated 3 years ago
• MingiJi / FRSKD

  View on GitHub
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆103Apr 30, 2024Updated last year
• enyac-group / Renofeation

  View on GitHub
  ☆19Jun 26, 2021Updated 4 years ago
• forjiuzhou / Spherical-Knowledge-Distillation

  View on GitHub
  ☆34Aug 20, 2023Updated 2 years ago
• ZhiluZhang123 / neurips_2020_distillation

  View on GitHub
  Code for "Self-Distillation as Instance-Specific Label Smoothing"
  ☆16Oct 22, 2020Updated 5 years ago
• DefangChen / SemCKD

  View on GitHub
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆78Jul 29, 2024Updated last year
• uuuChen / Filter-Pruning-with-Attention-Preserving-Self-Distillation

  View on GitHub
  ☆10Feb 22, 2022Updated 3 years ago
• Meta-knowledge-Lab / DLB

  View on GitHub
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆43Sep 27, 2022Updated 3 years ago
• HobbitLong / RepDistiller

  View on GitHub
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,426Oct 16, 2023Updated 2 years ago
• budnikm / aml

  View on GitHub
  ☆27Jun 20, 2021Updated 4 years ago
• JIA-Lab-research / ReviewKD

  View on GitHub
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆280Dec 16, 2022Updated 3 years ago
• AmirMansurian / AttnFD

  View on GitHub
  [WACV'26] Attention as Geometric Transformation: Revisiting Feature Distillation for Semantic Segmentation
  ☆42Jan 6, 2026Updated last month
• megvii-research / mdistiller

  View on GitHub
  The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…
  ☆889Nov 5, 2023Updated 2 years ago
• goldblum / AdversariallyRobustDistillation

  View on GitHub
  Pytorch implementation of Adversarially Robust Distillation (ARD)
  ☆59May 24, 2019Updated 6 years ago
• sihaoevery / TaT

  View on GitHub
  ☆27Jun 28, 2022Updated 3 years ago
• zhouzaida / channel-distillation

  View on GitHub
  PyTorch implementation for Channel Distillation
  ☆103Jun 9, 2020Updated 5 years ago
• ggjy / DeFeat.pytorch

  View on GitHub
  ☆114Apr 21, 2021Updated 4 years ago
• roymiles / ITRD

  View on GitHub
  [BMVC 2022] Information Theoretic Representation Distillation
  ☆19Oct 6, 2023Updated 2 years ago
• Kennethborup / self_distillation

  View on GitHub
  Self-Distillation with weighted ground-truth targets; ResNet and Kernel Ridge Regression
  ☆19Oct 12, 2021Updated 4 years ago
• alinlab / cs-kd

  View on GitHub
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆109Jun 18, 2020Updated 5 years ago
• szq0214 / FKD

  View on GitHub
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆190Apr 29, 2024Updated last year
• AberHu / Knowledge-Distillation-Zoo

  View on GitHub
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,742Nov 25, 2021Updated 4 years ago
• clovaai / overhaul-distillation

  View on GitHub
  Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)
  ☆423Jun 23, 2020Updated 5 years ago
• LTH14 / FSKD

  View on GitHub
  ☆31Jun 18, 2020Updated 5 years ago
• kaiyuyue / mgd

  View on GitHub
  PyTorch Implementation of Matching Guided Distillation [ECCV'20]
  ☆66Aug 7, 2021Updated 4 years ago
• zhengli97 / CTKD

  View on GitHub
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆182Dec 3, 2024Updated last year
• aryanasadianuoit / Distilling-Knowledge-via-Intermediate-Classifiers

  View on GitHub
  Distilling Knowledge via Intermediate Classifiers
  ☆16Oct 3, 2021Updated 4 years ago
• DefangChen / OKDDip

  View on GitHub
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆76Jul 6, 2023Updated 2 years ago
• FLHonker / Awesome-Knowledge-Distillation

  View on GitHub
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,654May 30, 2023Updated 2 years ago
• saibr / IOVPR

  View on GitHub
  This repository contains all code and data for the Inside Out Visual Place Recognition task
  ☆23Nov 24, 2021Updated 4 years ago
• HanshuYAN / CIFS

  View on GitHub
  CIFS: Improving Adversarial Robustness of CNNs via Channel-wise Importance-based Feature Selection
  ☆20Oct 12, 2021Updated 4 years ago
• robotnav-bot / EffoNAV

  View on GitHub
  ☆19Jan 16, 2026Updated last month
• zju-vipa / spot-adaptive-pytorch

  View on GitHub
  ☆24May 6, 2022Updated 3 years ago
• MKFMIKU / d2sm

  View on GitHub
  Deep Semantic Statistics Matching (D2SM) Denoising Network (ECCV22)
  ☆25Jul 21, 2022Updated 3 years ago
• naver-ai / negmerge

  View on GitHub
  [ICML 2025] Official PyTorch implementation of "NegMerge: Sign-Consensual Weight Merging for Machine Unlearning"
  ☆14Nov 25, 2025Updated 2 months ago
• WalterSimoncini / no-train-all-gain

  View on GitHub
  Code for the paper "No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations"
  ☆12Oct 31, 2024Updated last year
• dc3ea9f / RegionViT

  View on GitHub
  Unofficial implementation for "RegionViT: Regional-to-Local Attention for Vision Transformers"
  ☆10Aug 13, 2021Updated 4 years ago
• nikosips / UDON

  View on GitHub
  ☆10Nov 18, 2024Updated last year
• JingfeiChang / ACP-Automatic-Channel-Pruning

  View on GitHub
  [Applied Intelligence 2022] Python code for ACP
  ☆12Sep 5, 2023Updated 2 years ago