deep-optimization / ScaleKD
The official project website of "ScaleKD: Strong Vision Transformers Could Be Excellent Teachers"
☆14Updated this week
Related projects ⓘ
Alternatives and complementary repositories for ScaleKD
- The codebase for paper "PPT: Token Pruning and Pooling for Efficient Vision Transformer"☆17Updated this week
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆19Updated last year
- Pytorch implementation of our paper accepted by ECCV2022 -- Knowledge Condensation Distillation https://arxiv.org/abs/2207.05409☆30Updated last year
- [ECCV 2022] AMixer: Adaptive Weight Mixing for Self-attention Free Vision Transformers☆28Updated 2 years ago
- Official PyTorch Code for "Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?" (https://arxiv.org/abs/2305.12954)☆45Updated 11 months ago
- Official implementation for ICLR 2023 paper Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation☆14Updated 9 months ago
- EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm☆29Updated 2 years ago
- DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detection☆18Updated last year
- [ECCV 2024] Isomorphic Pruning for Vision Models☆53Updated 3 months ago
- SimMAT: Exploring Transferability from Vision Foundation Models to Any Image Modality☆22Updated 2 months ago
- Sambor: Boosting Segment Anything Model Towards Open-Vocabulary Learning☆30Updated 11 months ago
- Official code for BA-SAM:Scalable Bias-Mode Attention Mask for Segment Anything Model☆13Updated 4 months ago
- ☆22Updated 2 years ago
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆70Updated 3 months ago
- DiverGen (CVPR 2024) & BSGAL (ICML 2024)☆36Updated 2 weeks ago
- ☆25Updated 8 months ago
- Learning 1D Causal Visual Representation with De-focus Attention Networks☆30Updated 5 months ago
- [CVPR 2024] Exploring Orthogonality in Open World Object Detection☆37Updated 5 months ago
- PELA: Learning Parameter-Efficient Models with Low-Rank Approximation [CVPR 2024]☆13Updated 7 months ago
- Codes for ICML 2023 Learning Dynamic Query Combinations for Transformer-based Object Detection and Segmentation☆35Updated last year
- [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference☆25Updated 8 months ago
- Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"☆62Updated 2 years ago
- Pytorch implementation of Mix-Shifting-MLP (MS-MLP)☆16Updated 2 years ago
- Code for paper "Unsegment Anything by Simulating Deformation" (CVPR 2024)☆22Updated 5 months ago
- Code of our CVPR2024 paper - DiffusionMTL: Learning Multi-Task Denoising Diffusion Model from Partially Annotated Data☆42Updated 7 months ago
- Official Pytorch Implementation of BPKD : Boundary Privileged Knowledge Distillation For Semantic Segmentation☆19Updated last year
- [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…☆89Updated last year
- [ECCV-24] This is the official implementation of the paper "SEGIC: Unleashing the Emergent Correspondence for In-Context Segmentation".☆19Updated last month
- Official PyTorch implementation of Data-free Knowledge Distillation for Object Detection, WACV 2021.☆61Updated 3 years ago
- ☆52Updated last year