sutd-visual-computing-group / LS-KD-compatibilityLinks
[ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.
☆11Updated 2 years ago
Alternatives and similar repositories for LS-KD-compatibility
Users that are interested in LS-KD-compatibility are comparing it to the libraries listed below
Sorting:
- Learning from Limited and Imperfect Data (L2ID): Classification Challenges☆18Updated 4 years ago
- Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021☆15Updated 4 years ago
- [WACV2023] This is the official PyTorch impelementation of our paper "[Rethinking Rotation in Self-Supervised Contrastive Learning: Adapt…☆12Updated 2 years ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Updated 2 years ago
- NeurIPS 2022: Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label Learning☆17Updated 2 years ago
- Code for the ICML 2021 paper "Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer"☆11Updated 3 years ago
- ☆19Updated 4 years ago
- ☆10Updated last year
- ☆9Updated 4 years ago
- ☆14Updated 2 years ago
- This is an official implementation of our CVPR 2020 paper "Non-Local Neural Networks With Grouped Bilinear Attentional Transforms".☆12Updated 4 years ago
- TF-FD☆20Updated 2 years ago
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 3 years ago
- ☆18Updated last year
- ☆12Updated 3 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Updated last year
- Pytorch implementation of our paper accepted by ECCV2022 -- Knowledge Condensation Distillation https://arxiv.org/abs/2207.05409☆30Updated 2 years ago
- Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion☆19Updated 2 years ago
- [ICLR 2022]: Fast AdvProp☆35Updated 3 years ago
- i-mae Pytorch Repo☆20Updated last year
- Prior Knowledge Guided Unsupervised Domain Adaptation (ECCV 2022)☆17Updated 2 years ago
- 🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]☆21Updated last year
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated 2 years ago
- The official code repo for the paper "Mixture of Stochastic Experts for Modeling Aleatoric Uncertainty in Segmentation". (ICLR 2023)☆28Updated 2 years ago
- ☆12Updated 3 years ago
- Repository containing code for blockwise SSL training☆29Updated 8 months ago
- This repository contains the code for our AAAI2021 paper CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D Networks.☆12Updated 4 years ago
- Official repository for "Self-Distilled Vision Transformer for Domain Generalization" (ACCV-2022 ORAL)☆39Updated 2 years ago
- ☆13Updated 3 years ago
- ☆22Updated 3 years ago