Alternatives and similar repositories for MTKD

Users that are interested in MTKD are comparing it to the libraries listed below

• Rorozhl / MMKD
  This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).
  ☆25Updated 2 years ago
• TRillionZxY / WaveletAttention
  Wavelet-Attention CNN for Image Classification
  ☆29Updated 3 years ago
• FLHonker / AMTML-KD-code
  AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation
  ☆58Updated 4 years ago
• jahongir7174 / PolyLoss
  PolyLoss implementation using PyTorch
  ☆12Updated 3 years ago
• gbstack / AAAI-2022-papers
  AAAI 2022 papers with code
  ☆36Updated 3 years ago
• shicaiwei123 / SDD-CVPR2024
  Official code for Scale Decoupled Distillation
  ☆41Updated last year
• ttchengab / mixup
  ☆19Updated 3 years ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆78Updated 2 months ago
• Linwei94 / ICML2023-DualFocalLoss
  Code for "Dual Focal Loss for Calibration" (ICML 2023)
  ☆32Updated last month
• iCVTEAM / Dara
  Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning TPAMI 2023
  ☆20Updated last year
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• wyf0912 / MIXALL
  [ICASSP 2020] Code release of paper 'Heterogeneous Domain Generalization via Domain Mixup'
  ☆26Updated 4 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆146Updated 2 years ago
• Zhangshuojackpot / Student-Loss
  ☆10Updated last year
• qhfan / FAT
  [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction
  ☆24Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆64Updated 8 months ago
• hitcszx / ALFs
  Learning with Noisy Labels, Label Noise, ICML 2021
  ☆44Updated 2 years ago
• CVI-SZU / WaveCNet
  code for WaveCNet
  ☆17Updated 3 years ago
• ashleylqx / AIB
  Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021
  ☆15Updated 4 years ago
• CrownX / SPA
  Official implementation for SPA: A Graph Spectral Alignment Perspective for Domain Adaptation (NeurIPS 2023)
  ☆16Updated last year
• luilui97 / DSPP
  ACCV2022 Source Code of paper "Feature Decoupled Knowledge Distillation via Spatial Pyramid Pooling"
  ☆11Updated last year
• NeurAI-Lab / DoGo
  This is the official repo for the CVPR 2021 L2ID paper "Distill on the Go: Online knowledge distillation in self-supervised learning"
  ☆12Updated 3 years ago
• XuRuihan / ParCNetV2
  Official implementation of ParCNetV2
  ☆10Updated last year
• JiamingLv / WKD
  The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…
  ☆39Updated 5 months ago
• nkusyl / FViT
  Official code release of our paper "FViT: A Focal Vision Transformer with Gabor Filter"
  ☆16Updated last year
• ArchipLab-LinfengZhang / contrastive-deep-supervision
  Codes for ECCV2022 paper - contrastive deep supervision
  ☆69Updated 2 years ago
• atuannguyen / TIPI
  ☆10Updated 2 years ago
• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆79Updated last year
• hoangthangta / All-KAN
  All-KAN: All Kolmogorov-Arnold Networks We Know
  ☆16Updated 2 months ago