Alternatives and similar repositories for MTKD

Users that are interested in MTKD are comparing it to the libraries listed below

• Rorozhl / MMKD
  This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).
  ☆26Updated 2 years ago
• Linwei94 / ICML2023-DualFocalLoss
  Code for "Dual Focal Loss for Calibration" (ICML 2023)
  ☆32Updated 2 months ago
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• zju-SWJ / RLD
  Official implementation for "Knowledge Distillation with Refined Logits".
  ☆14Updated 10 months ago
• Ackesnal / GTP-ViT
  This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation
  ☆29Updated last year
• TRillionZxY / WaveletAttention
  Wavelet-Attention CNN for Image Classification
  ☆29Updated 3 years ago
• qhfan / FAT
  [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction
  ☆24Updated last year
• ZhugeKongan / -DataAug-and-NetRegularization
  pytorch implements data enhancement and network regularization methods: cutmix, cutout, shakedrop, mixup, Label smoothing
  ☆10Updated 3 years ago
• FLHonker / AMTML-KD-code
  AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation
  ☆59Updated 4 years ago
• sutd-visual-computing-group / LS-KD-compatibility
  [ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an L…
  ☆11Updated 2 years ago
• junfish / Awesome-Multitask-Learning
  This repository periodicly updates the MTL paper and resources
  ☆56Updated 2 months ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆78Updated 3 months ago
• marcoromanelli-github / ReliabilityDiagrams
  Create reliability diagrams to quantify ML calibration.
  ☆10Updated 3 years ago
• hitcszx / ALFs
  Learning with Noisy Labels, Label Noise, ICML 2021
  ☆45Updated 2 years ago
• BGU-CS-VIL / DiTAC
  Trainable Highly-expressive Activation Functions. ECCV 2024
  ☆38Updated 4 months ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆146Updated 2 years ago
• XueFuzhao / WideNet_Code
  Implementation of AAAI 2022 Paper: Go wider instead of deeper
  ☆32Updated 2 years ago
• yangyangxu0 / DeMT
  ☆76Updated last year
• jahongir7174 / PolyLoss
  PolyLoss implementation using PyTorch
  ☆12Updated 3 years ago
• ososos888 / prune-then-distill
  ☆47Updated 2 years ago
• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 2 years ago
• EnnengYang / AdaTask
  AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task Learning. AAAI, 2023.
  ☆28Updated last year
• iam-nacl / DTMFormer
  ☆11Updated last year
• Zhangshuojackpot / Student-Loss
  ☆10Updated last year
• HUANGLIZI / TFCNs
  [ICANN 2022 Oral] This repository includes the official project of TFCNs, presented in our paper: TFCNs: A CNN-Transformer Hybrid Networ…
  ☆17Updated 2 years ago
• pprp / Vision-Mamba-CIFAR10
  ☆23Updated last year
• selkerdawy / FTWT
  Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction
  ☆11Updated 3 years ago
• abhuse / polyloss-pytorch
  Polyloss Pytorch Implementation
  ☆44Updated 3 years ago
• lmbxmu / DCFF
  Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion
  ☆19Updated 2 years ago