Alternatives and similar repositories for channel-distillation

Users that are interested in channel-distillation are comparing it to the libraries listed below

• frankwang345 / pruning-from-scratch

  View on GitHub
  ☆19May 28, 2020Updated 5 years ago
• sundw2014 / DCM

  View on GitHub
  Knowledge Transfer via Dense Cross-layer Mutual-distillation (ECCV'2020)
  ☆30Aug 19, 2020Updated 5 years ago
• kaiyuyue / mgd

  View on GitHub
  PyTorch Implementation of Matching Guided Distillation [ECCV'20]
  ☆66Aug 7, 2021Updated 4 years ago
• lenscloth / RKD

  View on GitHub
  Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
  ☆414May 17, 2021Updated 4 years ago
• AnTuo1998 / AE-KD

  View on GitHub
  ☆27Feb 6, 2021Updated 5 years ago
• drilistbox / CWD

  View on GitHub
  Channel-wise Distillation for Semantic Segmentation
  ☆78Nov 26, 2020Updated 5 years ago
• ICCV-5-EENA / EENA

  View on GitHub
  ☆10Jul 5, 2019Updated 6 years ago
• HankKung / Auto-Dynamic-DeepLab

  View on GitHub
  [IROS 2021] ADD: A Fine-grained Dynamic Inference Architecture for Semantic Image Segmentation
  ☆10May 3, 2022Updated 3 years ago
• clovaai / overhaul-distillation

  View on GitHub
  Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)
  ☆423Jun 23, 2020Updated 5 years ago
• xuguodong03 / SSKD

  View on GitHub
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆238Dec 15, 2022Updated 3 years ago
• ofsoundof / group_sparsity

  View on GitHub
  Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression. CVPR2020.
  ☆64Jan 17, 2026Updated last month
• bhheo / AB_distillation

  View on GitHub
  Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)
  ☆106Sep 9, 2019Updated 6 years ago
• imirzadeh / Teacher-Assistant-Knowledge-Distillation

  View on GitHub
  Using Teacher Assistants to Improve Knowledge Distillation: https://arxiv.org/pdf/1902.03393.pdf
  ☆264Oct 3, 2019Updated 6 years ago
• cospDiDi / REFILLED

  View on GitHub
  This is the code of CVPR'20 paper "Distilling Cross-Task Knowledge via Relationship Matching".
  ☆49Feb 7, 2021Updated 5 years ago
• irfanICMLL / structure_knowledge_distillation

  View on GitHub
  The official code for the paper 'Structured Knowledge Distillation for Semantic Segmentation'. (CVPR 2019 ORAL) and extension to other ta…
  ☆740Apr 20, 2020Updated 5 years ago
• cadurosar / graph_kd

  View on GitHub
  Graph Knowledge Distillation
  ☆13Mar 6, 2020Updated 5 years ago
• fxmeng / filter-grafting

  View on GitHub
  Filter Grafting for Deep Neural Networks(CVPR 2020)
  ☆139Feb 4, 2022Updated 4 years ago
• MingiJi / FRSKD

  View on GitHub
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆103Apr 30, 2024Updated last year
• DefangChen / OKDDip

  View on GitHub
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆76Jul 6, 2023Updated 2 years ago
• lxtGH / QueryPanSeg

  View on GitHub
  Query Learning of Both Thing and Stuff for Panoptic Segmentation-ICIP-2022
  ☆15Sep 3, 2022Updated 3 years ago
• yuanli2333 / Teacher-free-Knowledge-Distillation

  View on GitHub
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆585Feb 15, 2023Updated 3 years ago
• lmbxmu / HRank

  View on GitHub
  Pytorch implementation of our paper accepted by CVPR 2020 (Oral) -- HRank: Filter Pruning using High-Rank Feature Map
  ☆257Feb 11, 2021Updated 5 years ago
• HobbitLong / RepDistiller

  View on GitHub
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,425Oct 16, 2023Updated 2 years ago
• clovaai / attention-feature-distillation

  View on GitHub
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆119Feb 9, 2021Updated 5 years ago
• IvLabs / stagewise-knowledge-distillation

  View on GitHub
  Code implementation of Data Efficient Stagewise Knowledge Distillation paper.
  ☆114Oct 19, 2020Updated 5 years ago
• Jangho-Kim / FFL-pytorch

  View on GitHub
  Feature Fusion for Online Mutual Knowledge Distillation Code
  ☆27Jul 21, 2020Updated 5 years ago
• szq0214 / MEAL-V2

  View on GitHub
  MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.
  ☆700Dec 24, 2021Updated 4 years ago
• Lechatelia / CRCD

  View on GitHub
  Complementary Relation Contrastive Distillation
  ☆17Jun 29, 2021Updated 4 years ago
• Irynei / SafeAugmentation

  View on GitHub
  ☆16Jun 18, 2025Updated 7 months ago
• enyac-group / Renofeation

  View on GitHub
  ☆19Jun 26, 2021Updated 4 years ago
• kevin-ssy / ViP

  View on GitHub
  Official implementation of the paper Visual Parser: Representing Part-whole Hierarchies with Transformers
  ☆121Aug 12, 2021Updated 4 years ago
• zhanghang1989 / RFConv

  View on GitHub
  Rectified Convolution
  ☆45Oct 16, 2022Updated 3 years ago
• szagoruyko / attention-transfer

  View on GitHub
  Improving Convolutional Networks via Attention Transfer (ICLR 2017)
  ☆1,463Jul 11, 2018Updated 7 years ago
• BayesWatch / pytorch-blockswap

  View on GitHub
  Code for BlockSwap (ICLR 2020).
  ☆33Mar 25, 2021Updated 4 years ago
• i13abe / Triplet-Loss-for-Knowledge-Distillation

  View on GitHub
  Triplet Loss for Knowledge Distillation
  ☆18Sep 4, 2022Updated 3 years ago
• lmbxmu / EPruner

  View on GitHub
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2021 -- Network Pruning using Adaptive Exemplar Filters
  ☆24Apr 4, 2021Updated 4 years ago
• YukangWang / IFVD

  View on GitHub
  Intra-class Feature Variation Distillation for Semantic Segmentation (ECCV 2020)
  ☆72Sep 10, 2020Updated 5 years ago
• LTH14 / FSKD

  View on GitHub
  ☆31Jun 18, 2020Updated 5 years ago
• StevenGrove / LearnableTreeFilterV2

  View on GitHub
  ☆92Jan 22, 2021Updated 5 years ago