ZuchniakK / MTKD
Multi-Teacher Knowledge Distillation, code for my PhD dissertation. I used knowledge distillation as a decision-fusion and compressing mechanism for ensemble models.
☆16Updated last year
Alternatives and similar repositories for MTKD
Users that are interested in MTKD are comparing it to the libraries listed below
Sorting:
- This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).☆23Updated 2 years ago
- [ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an L…☆11Updated 2 years ago
- ☆11Updated last year
- Decoupled Kullback-Leibler Divergence Loss (DKL), NeurIPS 2024 / Generalized Kullback-Leibler Divergence Loss (GKL)☆44Updated this week
- Switchable Online Knowledge Distillation☆18Updated 6 months ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)☆24Updated last year
- Wavelet-Attention CNN for Image Classification☆29Updated 3 years ago
- AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation☆57Updated 4 years ago
- [ICASSP-2021] Official implementations of Multi-View Contrastive Learning for Online Knowledge Distillation (MCL-OKD)☆27Updated 4 years ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆44Updated last year
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆77Updated last month
- (CVPR 2022) MulT: An End-to-End Multitask Learning Transformer☆59Updated last year
- ☆24Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆148Updated 2 years ago
- AAAI 2022 papers with code☆36Updated 3 years ago
- Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning TPAMI 2023☆20Updated 11 months ago
- This repository contains the pytorch code for our work IEEE ISBI 2024 paper "ConvLoRA and AdaBN Based Domain Adaptation via Self-Training…☆74Updated 7 months ago
- Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)☆68Updated 6 months ago
- code for WaveCNet☆17Updated 3 years ago
- This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation☆27Updated last year
- ☆26Updated last year
- ☆50Updated 2 years ago
- ☆10Updated 2 years ago
- Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021☆15Updated 3 years ago
- Learning with Noisy Labels, Label Noise, ICML 2021☆44Updated 2 years ago
- Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"☆40Updated 2 years ago
- Official repo for the WACV 2023 paper: Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer.☆29Updated last year
- [ICASSP 2020] Code release of paper 'Heterogeneous Domain Generalization via Domain Mixup'☆26Updated 4 years ago
- The offical implement of ImbSAM (Imbalanced-SAM)☆23Updated last year