Jin-Ying / Multi-Level-Logit-Distillation
Code for 'Multi-level Logit Distillation' (CVPR2023)
☆56Updated last month
Related projects ⓘ
Alternatives and complementary repositories for Multi-Level-Logit-Distillation
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆89Updated 2 years ago
- [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"☆158Updated 4 months ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆33Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆138Updated last year
- Official code for Scale Decoupled Distillation☆34Updated 7 months ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆97Updated 7 months ago
- [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…☆100Updated last year
- Official PyTorch implementation of PS-KD☆82Updated 2 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆72Updated 2 months ago
- [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation☆44Updated last year
- Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.☆29Updated 2 years ago
- [TPAMI-2023] Official implementations of L-MCL: Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition☆23Updated last year
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆71Updated last year
- [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…☆42Updated last year
- Official code for Cumulative Spatial Knowledge Distillation for Vision Transformers (ICCV-2023) https://openaccess.thecvf.com/content/ICC…☆14Updated last year
- [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass☆171Updated last year
- The offical implement of ImbSAM (Imbalanced-SAM)☆21Updated 8 months ago
- ☆23Updated 11 months ago
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆76Updated 9 months ago
- ☆82Updated last year
- ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching☆94Updated 5 months ago
- [CVPR-2024] Official implementations of CLIP-KD: An Empirical Study of CLIP Model Distillation☆75Updated 4 months ago
- ☆18Updated last month
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆64Updated last year
- The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)☆40Updated last year
- 【ICCV 2023】Towards Instance-adaptive Inference for Federated Learning☆12Updated last year
- Official implementation of the paper "Function-Consistent Feature Distillation" (ICLR 2023)☆27Updated last year
- Efficient Dataset Distillation by Representative Matching☆107Updated 8 months ago
- [NeurIPS'22] Projector Ensemble Feature Distillation☆29Updated 10 months ago
- [IJCAI-2021] Contrastive Model Inversion for Data-Free Knowledge Distillation☆68Updated 2 years ago