roymiles / Simple-Recipe-DistillationLinks
[AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation
☆18Updated last year
Alternatives and similar repositories for Simple-Recipe-Distillation
Users that are interested in Simple-Recipe-Distillation are comparing it to the libraries listed below
Sorting:
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆88Updated last year
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆128Updated last year
- The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction☆21Updated last year
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆46Updated 6 months ago
- 1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundatio…☆221Updated 10 months ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆54Updated 8 months ago
- [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass☆192Updated last year
- [ECCV 2024] Isomorphic Pruning for Vision Models☆71Updated 11 months ago
- CVPR 2023, Class Attention Transfer Based Knowledge Distillation☆44Updated 2 years ago
- Project Page for "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"☆82Updated last month
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆67Updated 9 months ago
- Official code for Scale Decoupled Distillation☆42Updated last year
- [PR 2024] Official PyTorch Code for "Dual Teachers for Self-Knowledge Distillation"☆12Updated 7 months ago
- ☆66Updated 2 years ago
- Official code for Cumulative Spatial Knowledge Distillation for Vision Transformers (ICCV-2023) https://openaccess.thecvf.com/content/ICC…☆15Updated last year
- [ICCV23] Robust Mixture-of-Expert Training for Convolutional Neural Networks by Yihua Zhang, Ruisi Cai, Tianlong Chen, Guanhua Zhang, Hua…☆60Updated last year
- ImageNet-1K data download, processing for using as a dataset☆100Updated 2 years ago
- “SURE: SUrvey REcipes for building reliable and robust deep networks” (CVPR 2024) & (ECCV 2024 OOD-CV Challenge Winner)☆63Updated 8 months ago
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆106Updated last year
- [CVPR'24] Official implementation of paper "FreeKD: Knowledge Distillation via Semantic Frequency Prompt".☆46Updated last year
- Adapters Strike Back (CVPR 2024)☆36Updated 11 months ago
- ☆22Updated last year
- ☆86Updated last year
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆79Updated 3 months ago
- Official repository of Slide-Transformer (CVPR2023)☆171Updated 10 months ago
- CLAP: Isolating Content from Style through Contrastive Learning with Augmented Prompts☆51Updated 10 months ago
- [NeurIPS 2024] official code release for our paper "Revisiting the Integration of Convolution and Attention for Vision Backbone".☆40Updated 5 months ago
- [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions☆61Updated last year
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆72Updated last year
- [CVPR-2024] Official implementations of CLIP-KD: An Empirical Study of CLIP Model Distillation☆122Updated last year