ZuchniakK / MTKD
Multi-Teacher Knowledge Distillation, code for my PhD dissertation. I used knowledge distillation as a decision-fusion and compressing mechanism for ensemble models.
☆14Updated last year
Alternatives and similar repositories for MTKD:
Users that are interested in MTKD are comparing it to the libraries listed below
- This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).☆21Updated last year
- Official implementation for SPA: A Graph Spectral Alignment Perspective for Domain Adaptation (NeurIPS 2023)☆11Updated last year
- Wavelet-Attention CNN for Image Classification☆26Updated 3 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆74Updated 2 months ago
- [ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an L…☆11Updated 2 years ago
- [ICASSP 2020] Code release of paper 'Heterogeneous Domain Generalization via Domain Mixup'☆24Updated 4 years ago
- Official implementation for "Knowledge Distillation with Refined Logits".☆13Updated 5 months ago
- Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.☆32Updated 2 years ago
- An Explainable Neural Network for Fault Diagnosis With a Frequency Activation Map☆13Updated 3 years ago
- Domain Generalization by Learning and Removing Domain-specific Features, NeurIPS 2022☆23Updated last year
- ☆9Updated last year
- ☆56Updated 4 years ago
- ☆10Updated 9 months ago
- Pytorch implementation of Split to Merge: Unifying Separated Modalities for Unsupervised Domain Adaptation (CVPR'24)☆25Updated 8 months ago
- The offical implement of ImbSAM (Imbalanced-SAM)☆23Updated 11 months ago
- Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning TPAMI 2023☆21Updated 8 months ago
- code for WaveCNet☆17Updated 3 years ago
- [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction☆23Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆140Updated 2 years ago
- T-SVDNet: Exploring High-Order Prototypical Correlations for Multi-Source Domain Adaptation☆20Updated last year
- ☆14Updated 3 years ago
- This repository contains PyTorch implementation of the following paper: SAGAN: SKIP-ATTENTION GAN FOR ANOMALY DETECTION.☆14Updated 2 years ago
- Official implementation of FullMatch (CVPR2023)☆44Updated last year
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆92Updated 2 years ago
- Code for our method CALS (Class Adaptive Label Smoothing) for network calibration. To Appear at CVPR 2023. Paper: https://arxiv.org/abs/2…☆23Updated last year
- Codes for ECCV2022 paper - contrastive deep supervision☆68Updated 2 years ago
- BM-NAS: Bilevel Multimodal Neural Architecture Search (AAAI 2022 Oral)☆17Updated 2 years ago
- Re-implementation of Online Label Smoothing.☆20Updated 3 years ago
- [ICASSP-2021] Official implementations of Multi-View Contrastive Learning for Online Knowledge Distillation (MCL-OKD)☆26Updated 3 years ago
- Trainable Highly-expressive Activation Functions. ECCV 2024☆37Updated 3 months ago