roymiles / Simple-Recipe-Distillation
[AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation
☆16Updated last year
Alternatives and similar repositories for Simple-Recipe-Distillation:
Users that are interested in Simple-Recipe-Distillation are comparing it to the libraries listed below
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆52Updated 5 months ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆43Updated 3 months ago
- ☆13Updated 9 months ago
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆81Updated last year
- [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".☆52Updated 2 years ago
- The official implementation of "Adapter is All You Need for Tuning Visual Tasks".☆100Updated 3 weeks ago
- Project Page for "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"☆69Updated 3 months ago
- GroupMamba: Parameter-Efficient and Accurate Group Visual State Space Model [CVPR -2025]☆82Updated last week
- [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions☆60Updated 11 months ago
- The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction☆15Updated last year
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆74Updated 7 months ago
- This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆71Updated 9 months ago
- The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…☆31Updated 3 months ago
- [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass☆179Updated last year
- [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference☆29Updated last year
- Official code for Scale Decoupled Distillation☆40Updated 11 months ago
- [ECCV 2024] Official implementation of the paper "Towards Latent Masked Image Modeling for Self-Supervised Visual Representation Learning…☆26Updated 3 weeks ago
- Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …☆35Updated last year
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆104Updated last year
- [NeurIPS 2024] official code release for our paper "Revisiting the Integration of Convolution and Attention for Vision Backbone".☆35Updated 2 months ago
- ☆25Updated last week
- [ECCV 2024] Isomorphic Pruning for Vision Models☆66Updated 8 months ago
- Official PyTorch implementation of Agglomerative Token Clustering presented at ECCV 2024☆16Updated 6 months ago
- Adapters Strike Back (CVPR 2024)☆35Updated 8 months ago
- Official implementation for ICLR 2023 paper Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation☆16Updated last year
- ☆65Updated 2 years ago
- [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…☆94Updated last year
- CVPR2024: Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models☆69Updated 8 months ago
- [ECCV2024] ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inference☆77Updated this week
- ☆62Updated last month