Qualcomm-AI-research / skip-attentionLinks
☆21Updated last year
Alternatives and similar repositories for skip-attention
Users that are interested in skip-attention are comparing it to the libraries listed below
Sorting:
- The official implementation for ALOFT (CVPR 2023).☆57Updated 2 years ago
- Official PyTorch implementation of ResFormer: Scaling ViTs with Multi-Resolution Training, CVPR2023☆30Updated 2 years ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆57Updated last year
- Trainable Highly-expressive Activation Functions. ECCV 2024☆38Updated 10 months ago
- PyTorch code for Diffusion Mechanism in Neural Network: Theory and Applications☆40Updated last year
- Switchable Online Knowledge Distillation☆19Updated last year
- The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…☆49Updated last year
- Official code release of our paper "FViT: A Focal Vision Transformer with Gabor Filter"☆19Updated 4 months ago
- PyTorch implementation of PaCa-ViT (CVPR'23)☆35Updated 2 years ago
- [ACM MM'23] Official implementation of paper "Avatar Knowledge Distillation: Self-ensemble Teacher Paradigm with Uncertainty".☆14Updated 2 years ago
- ☆37Updated 2 years ago
- ☆31Updated 3 years ago
- This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer☆55Updated 3 years ago
- Unsupervised Test Time Adaptation with Normalizing Flows☆11Updated 3 years ago
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆85Updated 9 months ago
- Official code release of our paper "EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attention"☆21Updated 4 months ago
- Scattering Vision Transformer☆54Updated last year
- Official implementation of the paper ``W2N: Switching From Weak Supervision to Noisy Supervision for Object Detection"☆29Updated 3 years ago
- CVPR2024 highlight.☆13Updated last year
- Adaptive Split-Fusion Transformer (ICME 2023 Oral)☆17Updated last year
- ☆30Updated 3 years ago
- Vision Transformers with Hierarchical Attention☆102Updated 4 months ago
- ☆65Updated last year
- ☆12Updated last year
- [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction☆55Updated 2 years ago
- Official PyTorch implementation of "DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation" (CVPR 2023)☆29Updated last year
- EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm☆35Updated 3 years ago
- [CVPR 2024] Exploring Orthogonality in Open World Object Detection☆55Updated 8 months ago
- ☆12Updated last year
- ☆15Updated last year