ZuchniakK / MTKD
Multi-Teacher Knowledge Distillation, code for my PhD dissertation. I used knowledge distillation as a decision-fusion and compressing mechanism for ensemble models.
☆15Updated last year
Alternatives and similar repositories for MTKD:
Users that are interested in MTKD are comparing it to the libraries listed below
- This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).☆22Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation☆55Updated 4 years ago
- Official implementation for "Knowledge Distillation with Refined Logits".☆13Updated 7 months ago
- Wavelet-Attention CNN for Image Classification☆28Updated 3 years ago
- Official repository of our work "Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning" accepted at CVPR 20…☆21Updated last month
- Code for "Dual Focal Loss for Calibration" (ICML 2023)☆31Updated 5 months ago
- (CVPR 2022) MulT: An End-to-End Multitask Learning Transformer☆56Updated 11 months ago
- ☆24Updated 3 years ago
- The official implementation for ALOFT (CVPR 2023).☆53Updated last year
- ☆10Updated 10 months ago
- This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation☆27Updated last year
- Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning TPAMI 2023☆21Updated 10 months ago
- ☆25Updated last year
- Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"☆40Updated 2 years ago
- [NeurIPS2023]Lightweight Vision Transformer with Bidirectional Interaction☆23Updated last year
- ☆14Updated 6 months ago
- Official implementation of FullMatch (CVPR2023)☆44Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆143Updated 2 years ago
- ☆19Updated 3 years ago
- Energy-based Out-of-distribution Detection☆15Updated 4 years ago
- Convolutional Initialization for Data-Efficient Vision Transformers☆14Updated last year
- PolyLoss implementation using PyTorch☆12Updated 2 years ago
- 🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]☆22Updated last year
- Unofficial implementation of ECCV 2020 paper "Feature Space Augmentation for Long-Tailed Data"☆24Updated 2 years ago
- ☆9Updated last year
- TF-FD☆20Updated 2 years ago
- Densely Guided Knowledge Distillation using Multiple Teacher Assistants☆10Updated 3 years ago
- Official PyTorch(MMCV) implementation of “Adversarial AutoMixup” (ICLR 2024 spotlight)☆65Updated 5 months ago
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆103Updated last year