Alternatives and similar repositories for Distilling-Knowledge-via-Intermediate-Classifiers

Users that are interested in Distilling-Knowledge-via-Intermediate-Classifiers are comparing it to the libraries listed below

• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆50Updated 3 years ago
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆76Updated 2 years ago
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆34Updated last year
• SJLeo / FFSD
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 -- Distilling a Powerful Student Model via Online Knowledge Distillation
  ☆31Updated 4 years ago
• gmum / Zero-Time-Waste
  ☆14Updated 2 years ago
• Soptq / Dynamic_Load_Balance_DistributedDNN
  Official Pytorch implementation of "DBS: Dynamic Batch Size for Distributed Deep Neural Network Training"
  ☆24Updated 4 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• cadurosar / graph_kd
  Graph Knowledge Distillation
  ☆13Updated 5 years ago
• VITA-Group / Random_Pruning
  [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…
  ☆77Updated 3 years ago
• ArchipLab-LinfengZhang / pytorch-scalable-neural-networks
  A pytorch implement of scalable neural netowrks.
  ☆23Updated 5 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆34Updated 2 years ago
• haolibai / Cross-Distillation
  Codes for paper "Few Shot Network Compression via Cross Distillation", AAAI 2020.
  ☆31Updated 5 years ago
• xeanzheng / CSKD
  Codes for ECCV2020 paper "Improving Knowledge Distillation via Category Structure".
  ☆10Updated 4 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆118Updated 4 years ago
• da2so / Zero-shot_Knowledge_Distillation_Pytorch
  ZSKD with PyTorch
  ☆31Updated 2 years ago
• boone891214 / MEST
  [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…
  ☆18Updated 3 years ago
• mary-phuong / multiexit-distillation
  ☆23Updated 6 years ago
• RAIVNLab / STR
  Soft Threshold Weight Reparameterization for Learnable Sparsity
  ☆90Updated 2 years ago
• fangvv / awesome-edge-intelligence-collections
  About DNN compression and acceleration on Edge Devices.
  ☆57Updated 4 years ago
• MingSun-Tse / Awesome-Pruning-at-Initialization
  [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.
  ☆59Updated 2 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆168Updated 5 years ago
• AnTuo1998 / AE-KD
  ☆27Updated 4 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆43Updated 3 years ago
• da2so / Data-Free_Network_Quantization_With_Adversarial_Knowledge_Distillation
  Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch
  ☆30Updated 4 years ago
• lliai / Auto-Prox-AAAI24
  Auto-Prox-AAAI24
  ☆14Updated last year
• epfml / LocalSGD-Code
  ☆46Updated 5 years ago
• rmccorm4 / Tiny-Imagenet-200
  🔬 Some personal research code on analyzing CNNs. Started with a thorough exploration of Stanford's Tiny-Imagenet-200 dataset.
  ☆105Updated 6 years ago
• chaoyanghe / FedNAS
  FedNAS: Federated Deep Learning via Neural Architecture Search
  ☆54Updated 4 years ago
• lirundong / quant-pack
  [Ongoing Project] Codebase for network quantization study.
  ☆12Updated 5 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆77Updated last year