sutd-visual-computing-group / LS-KD-compatibilityLinks
[ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.
☆11Updated 2 years ago
Alternatives and similar repositories for LS-KD-compatibility
Users that are interested in LS-KD-compatibility are comparing it to the libraries listed below
Sorting:
- ☆14Updated 2 years ago
- Github repository for the paper Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers.☆30Updated 4 months ago
- This repository including most of cnn visualizations techniques using pytorch☆14Updated 5 years ago
- [ICME-2022] Official implementations of Localizing Semantic Patches for Accelerating Image Classification☆16Updated 3 years ago
- ☆19Updated 4 years ago
- Code for <Scale variance minimization for unsupervised domain adaptation in image segmentation> in Pattern Recognition 2021☆9Updated 3 years ago
- NeurIPS 2022: Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label Learning☆17Updated 2 years ago
- 🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]☆21Updated last year
- Learning from Limited and Imperfect Data (L2ID): Classification Challenges☆18Updated 4 years ago
- Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion☆19Updated 2 years ago
- The official code repo for the paper "Mixture of Stochastic Experts for Modeling Aleatoric Uncertainty in Segmentation". (ICLR 2023)☆28Updated 2 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Updated last year
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated 2 years ago
- This repository contains the code for our AAAI2021 paper CAKES: Channel-wise Automatic KErnel Shrinking for Efficient 3D Networks.☆12Updated 4 years ago
- Information Bottleneck Approach to Spatial Attention Learning, IJCAI2021☆15Updated 4 years ago
- TF-FD☆20Updated 2 years ago
- Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)☆24Updated last year
- Prior Knowledge Guided Unsupervised Domain Adaptation (ECCV 2022)☆17Updated 2 years ago
- ☆10Updated last year
- Source code for the BMVC-2021 paper "SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation".☆16Updated 3 years ago
- Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning TPAMI 2023☆21Updated last year
- Official implementation of "Dynamic Label Injection for Imbalanced Industrial Defect Segmentation" accepted at VISION Workshop - ECCV 202…☆12Updated last month
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 3 years ago
- This repo is the official megengine implementation of the ECCV2022 paper: Efficient One Pass Self-distillation with Zipf's Label Smoothin…☆26Updated 2 years ago
- Official repository for Is your noise correction noisy? PLS: Robustness to label noise with two stage detection WACV 2023☆20Updated 2 years ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Updated 2 years ago
- ☆30Updated 4 months ago
- [WACV2023] This is the official PyTorch impelementation of our paper "[Rethinking Rotation in Self-Supervised Contrastive Learning: Adapt…☆12Updated 2 years ago
- Code of CropMix: Sampling a Rich Input Distribution via Multi-Scale Cropping☆17Updated 2 years ago
- ☆12Updated 4 years ago