sutd-visual-computing-group / LS-KD-compatibilityView on GitHub
[ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an LS-trained teacher with a low-temperature transfer to render high performance students.
☆13Dec 8, 2022Updated 3 years ago

Alternatives and similar repositories for LS-KD-compatibility

Users that are interested in LS-KD-compatibility are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?