Alternatives and similar repositories for Distilling-Knowledge-via-Intermediate-Classifiers

Users that are interested in Distilling-Knowledge-via-Intermediate-Classifiers are comparing it to the libraries listed below

• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆74Updated last year
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆32Updated 9 months ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• cadurosar / graph_kd
  Graph Knowledge Distillation
  ☆13Updated 5 years ago
• AnTuo1998 / AE-KD
  ☆26Updated 4 years ago
• da2so / Data-Free_Network_Quantization_With_Adversarial_Knowledge_Distillation
  Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch
  ☆29Updated 3 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 9 months ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• haolibai / Cross-Distillation
  Codes for paper "Few Shot Network Compression via Cross Distillation", AAAI 2020.
  ☆31Updated 5 years ago
• MingSun-Tse / Awesome-Pruning-at-Initialization
  [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.
  ☆59Updated last year
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆117Updated 4 years ago
• SJLeo / FFSD
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 -- Distilling a Powerful Student Model via Online Knowledge Distillation
  ☆28Updated 3 years ago
• shriramsb / Distilling-the-Knowledge-in-a-Neural-Network
  Demonstration of transfer of knowledge and generalization with distillation
  ☆53Updated 6 years ago
• bolianchen / Data-Free-Learning-of-Student-Networks
  ☆22Updated 4 years ago
• da2so / Zero-shot_Knowledge_Distillation_Pytorch
  ZSKD with PyTorch
  ☆30Updated last year
• MingSun-Tse / Smile-Pruning
  A generic code base for neural network pruning, especially for pruning at initialization.
  ☆30Updated 2 years ago
• xeanzheng / CSKD
  Codes for ECCV2020 paper "Improving Knowledge Distillation via Category Structure".
  ☆10Updated 4 years ago
• AlumLuther / PruningFilters
  Pruning Filters For Efficient ConvNets, PyTorch Implementation.
  ☆30Updated 5 years ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆100Updated 4 years ago
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆33Updated last year
• VITA-Group / SFW-Once-for-All-Pruning
  [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…
  ☆29Updated 3 years ago
• Jangho-Kim / FFL-pytorch
  Feature Fusion for Online Mutual Knowledge Distillation Code
  ☆26Updated 4 years ago
• zyxxmu / White-Box
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 — Carrying out CNN Channel Pruning in a White Box
  ☆18Updated 3 years ago
• ZhiluZhang123 / neurips_2020_distillation
  Code for "Self-Distillation as Instance-Specific Label Smoothing"
  ☆16Updated 4 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆33Updated last year
• ArchipLab-LinfengZhang / pytorch-scalable-neural-networks
  A pytorch implement of scalable neural netowrks.
  ☆23Updated 4 years ago
• lliai / Auto-Prox-AAAI24
  Auto-Prox-AAAI24
  ☆13Updated last year
• sseung0703 / Variational_Information_Distillation
  Reproducing VID in CVPR2019 (on working)
  ☆20Updated 5 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago