sutd-visual-computing-group / LS-KD-compatibility
[ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.
☆11Updated 2 years ago
Alternatives and similar repositories for LS-KD-compatibility:
Users that are interested in LS-KD-compatibility are comparing it to the libraries listed below
- TF-FD☆20Updated 2 years ago
- Learning from Limited and Imperfect Data (L2ID): Classification Challenges☆18Updated 4 years ago
- NeurIPS 2022: Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label Learning☆17Updated 2 years ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Updated 2 years ago
- Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021☆15Updated 3 years ago
- Paper and Code for "Curriculum Learning by Optimizing Learning Dynamics" (AISTATS 2021)☆19Updated 3 years ago
- Data-free knowledge distillation using Gaussian noise (NeurIPS paper)☆15Updated 2 years ago
- [BMVC 2022] Information Theoretic Representation Distillation☆18Updated last year
- ☆14Updated 2 years ago
- Learning with Noisy Labels, Label Noise, ICML 2021☆44Updated 2 years ago
- ☆11Updated 2 years ago
- Prior Knowledge Guided Unsupervised Domain Adaptation (ECCV 2022)☆17Updated 2 years ago
- [ICLR 2022]: Fast AdvProp☆35Updated 3 years ago
- [WACV2023] This is the official PyTorch impelementation of our paper "[Rethinking Rotation in Self-Supervised Contrastive Learning: Adapt…☆12Updated 2 years ago
- Official codebase for our paper "Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks"☆12Updated 3 years ago
- Black-box Few-shot Knowledge Distillation☆13Updated 2 years ago
- ☆20Updated 2 years ago
- An open-world scenario domain generalization code base☆26Updated 2 years ago
- ☆16Updated last year
- Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning TPAMI 2023☆21Updated 10 months ago
- The offical implement of ImbSAM (Imbalanced-SAM)☆22Updated last year
- Code for the ICML 2021 paper "Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer"☆11Updated 3 years ago
- ☆13Updated 2 years ago
- [ICASSP 2020] Code release of paper 'Heterogeneous Domain Generalization via Domain Mixup'☆26Updated 4 years ago
- WACV 2023 - Treatment Learning Causal Transformer for Noisy Image Classification☆9Updated 2 years ago
- This repository includes the official project of L2B, from our paper "Learning to Bootstrap for Combating Label Noise".☆32Updated last month
- This repo provides the codebase for "A General Framework for Weak Supervision"☆34Updated 10 months ago
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 3 years ago
- Official Repository for Soft Augmentation☆18Updated last year
- Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion☆19Updated 2 years ago