Alternatives and similar repositories for MTKD

Users that are interested in MTKD are comparing it to the libraries listed below

• Rorozhl / MMKD
  This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).
  ☆29Updated 2 years ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆84Updated last year
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆179Updated 10 months ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆149Updated 2 years ago
• TRillionZxY / WaveletAttention
  Wavelet-Attention CNN for Image Classification
  ☆31Updated 3 years ago
• Delay-Xili / SDNet
  An official codebase of paper "Revisiting Sparse Convolutional Model for Visual Recognition"
  ☆125Updated 2 years ago
• Kurumi233 / OnlineLabelSmoothing
  Re-implementation of Online Label Smoothing.
  ☆20Updated 4 years ago
• xxgege / GAM
  The official repo for CVPR2023 highlight paper "Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization".
  ☆84Updated 2 years ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆80Updated 6 months ago
• Rorozhl / CA-MKD
  This is the implementation for the ICASSP-2022 paper (Confidence-Aware Multi-Teacher Knowledge Distillation).
  ☆63Updated 3 years ago
• sail-sg / iFormer
  iFormer: Inception Transformer
  ☆247Updated 2 years ago
• FLHonker / AMTML-KD-code
  AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation
  ☆62Updated 4 years ago
• liuruiyang98 / Jittor-MLP
  Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…
  ☆169Updated 3 years ago
• ljjcoder / Probabilistic-Contrastive-Learning
  Probabilistic Contrastive Learning for Domain Adaptation
  ☆14Updated last year
• Linwei94 / ICML2023-DualFocalLoss
  Code for "Dual Focal Loss for Calibration" (ICML 2023)
  ☆32Updated 5 months ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆181Updated 3 years ago
• lyy0908 / t-SNE-CNN
  对卷积神经网络提取的每一层特征用t-SNE进行降维可视化
  ☆22Updated 3 years ago
• Jenniferlyx / Explaining-Knowledge-Distillation-by-Quantifying-the-Knowledge
  ☆16Updated 4 years ago
• microsoft / TokenMixers
  ☆151Updated last year
• LiQiufu / WaveCNet
  the code for WaveCNet
  ☆134Updated last year
• qhfan / FAT
  [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction
  ☆26Updated last year
• gbstack / AAAI-2022-papers
  AAAI 2022 papers with code
  ☆37Updated 3 years ago
• CownowAn / DaSS
  Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)
  ☆26Updated last year
• coeusguo / ceit
  ☆63Updated 4 years ago
• WZY10065 / Modified_ElsevierTemplates
  Elsevier Templates-Latex
  ☆63Updated 4 months ago
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆69Updated last year
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆43Updated 3 years ago
• yun-liu / HAT-Net
  Vision Transformers with Hierarchical Attention
  ☆102Updated last month
• 2-Chae / PyTorch-tSNE
  ☆56Updated 4 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆100Updated 3 years ago