sutd-visual-computing-group / LS-KD-compatibility
[ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.
☆11Updated 2 years ago
Alternatives and similar repositories for LS-KD-compatibility:
Users that are interested in LS-KD-compatibility are comparing it to the libraries listed below
- Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021☆14Updated 3 years ago
- [ICLR 2022]: Fast AdvProp☆34Updated 2 years ago
- TF-FD☆20Updated 2 years ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Updated 2 years ago
- 🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]☆21Updated last year
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆19Updated last year
- Official Repository for Soft Augmentation☆18Updated last year
- [WACV2023] This is the official PyTorch impelementation of our paper "[Rethinking Rotation in Self-Supervised Contrastive Learning: Adapt…☆12Updated 2 years ago
- Learning from Limited and Imperfect Data (L2ID): Classification Challenges☆18Updated 4 years ago
- ☆18Updated 10 months ago
- NeurIPS 2022: Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label Learning☆17Updated 2 years ago
- PyTorch implementation for our paper EvidentialMix: Learning with Combined Open-set and Closed-set Noisy Labels☆28Updated 4 years ago
- Prior Knowledge Guided Unsupervised Domain Adaptation (ECCV 2022)☆17Updated 2 years ago
- Data-free knowledge distillation using Gaussian noise (NeurIPS paper)☆15Updated last year
- [BMVC 2022] Information Theoretic Representation Distillation☆18Updated last year
- ☆13Updated 2 years ago
- ☆19Updated 2 years ago
- Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion☆19Updated 2 years ago
- ☆29Updated last year
- ☆11Updated 2 years ago
- ☆14Updated 2 years ago
- Paper and Code for "Curriculum Learning by Optimizing Learning Dynamics" (AISTATS 2021)☆19Updated 3 years ago
- ☆19Updated 3 years ago
- This is an official implementation of our CVPR 2020 paper "Non-Local Neural Networks With Grouped Bilinear Attentional Transforms".☆12Updated 4 years ago
- [ICASSP 2020] Code release of paper 'Heterogeneous Domain Generalization via Domain Mixup'☆25Updated 4 years ago
- The reproduce for "AM-LFS: AutoML for Loss Function Search"☆14Updated 4 years ago
- ☆13Updated 2 years ago
- ☆22Updated 3 years ago
- Code for the ICML 2021 paper "Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer"☆11Updated 3 years ago
- i-mae Pytorch Repo☆20Updated 11 months ago