ZuchniakK / MTKD
Multi-Teacher Knowledge Distillation, code for my PhD dissertation. I used knowledge distillation as a decision-fusion and compressing mechanism for ensemble models.
☆13Updated last year
Alternatives and similar repositories for MTKD:
Users that are interested in MTKD are comparing it to the libraries listed below
- ☆10Updated 8 months ago
- AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation☆54Updated 3 years ago
- This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).☆20Updated last year
- Pytorch implementation of DAC-Net ("Zhongying Deng, Kaiyang Zhou, Yongxin Yang, Tao Xiang. Domain Attention Consistency for Multi-Source …☆22Updated 3 years ago
- This is an official PyTorch implementation of the ICML 2023 paper AdaNPC and SIGKDD paper DRM.☆84Updated 9 months ago
- Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"☆40Updated 2 years ago
- PolyLoss implementation using PyTorch☆12Updated 2 years ago
- The offical implement of ImbSAM (Imbalanced-SAM)☆23Updated 10 months ago
- Code for "Dual Focal Loss for Calibration" (ICML 2023)☆28Updated 2 months ago
- Multi-head Recurrent Layer Attention for Vision Network☆19Updated last year
- This is the implementation of our CVPR'23 paper "Class-Conditional Sharpness-Aware Minimization for Deep Long-Tailed Recognition".☆17Updated last year
- ☆9Updated last year
- [ECCV 2022] Implementation of the paper "Locality Guidance for Improving Vision Transformers on Tiny Datasets"☆77Updated 2 years ago
- Official implementation for "Pure Noise to the Rescue of Insufficient Data: Improving Imbalanced Classification by Training on Random Noi…☆15Updated 2 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆74Updated last month
- [NeurIPS 2023] Understanding and Improving Feature Learning for Out-of-Distribution Generalization☆27Updated 7 months ago
- Official implementation for SPA: A Graph Spectral Alignment Perspective for Domain Adaptation (NeurIPS 2023)☆11Updated last year
- Code for our method CALS (Class Adaptive Label Smoothing) for network calibration. To Appear at CVPR 2023. Paper: https://arxiv.org/abs/2…☆23Updated last year
- Domain Generalization by Learning and Removing Domain-specific Features, NeurIPS 2022☆22Updated last year
- [ICCVW2023] Robust Asymmetric Loss for Multi-Label Long-Tailed Learning☆17Updated last year
- T-SVDNet: Exploring High-Order Prototypical Correlations for Multi-Source Domain Adaptation☆20Updated last year
- Official implementation of FullMatch (CVPR2023)☆44Updated last year
- Official code for the ICCV23 paper: "Domain Generalization via Rationale Invariance"☆20Updated 7 months ago
- [ICASSP-2021] Official implementations of Multi-View Contrastive Learning for Online Knowledge Distillation (MCL-OKD)☆26Updated 3 years ago
- Paper List for Multi-Task Learning (focus on architectures and optimization for MTL)☆44Updated last year
- LiVT PyTorch Implementation.☆67Updated last year
- Decoupled Kullback-Leibler Divergence Loss (DKL), NeurIPS 2024☆36Updated 2 months ago
- ☆74Updated last year
- Unsupervised Domain Adaptation for Computer Vision Tasks☆101Updated 2 years ago
- Official implementation for "Knowledge Distillation with Refined Logits".☆13Updated 4 months ago