Qualcomm-AI-research / skip-attentionLinks
☆21Updated last year
Alternatives and similar repositories for skip-attention
Users that are interested in skip-attention are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation of ResFormer: Scaling ViTs with Multi-Resolution Training, CVPR2023☆30Updated 2 years ago
- The official implementation for ALOFT (CVPR 2023).☆57Updated 2 years ago
- This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer☆55Updated 3 years ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆56Updated last year
- The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…☆45Updated 11 months ago
- PyTorch code for Diffusion Mechanism in Neural Network: Theory and Applications☆40Updated last year
- Trainable Highly-expressive Activation Functions. ECCV 2024☆38Updated 9 months ago
- EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm☆34Updated 3 years ago
- Official code release of our paper "FViT: A Focal Vision Transformer with Gabor Filter"☆18Updated 3 months ago
- ☆37Updated 2 years ago
- PyTorch implementation of PaCa-ViT (CVPR'23)☆34Updated 2 years ago
- Official repository for the paper "Salient Mask-Guided Vision Transformer for Fine-Grained Classification" (VISIGRAPP '23)☆21Updated 2 years ago
- CVPR2024 highlight.☆13Updated last year
- ☆32Updated 3 years ago
- ☆43Updated 2 years ago
- ☆12Updated 11 months ago
- Vision Transformers with Hierarchical Attention☆102Updated 2 months ago
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆106Updated 2 years ago
- Official PyTorch implementation of "DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation" (CVPR 2023)☆29Updated last year
- ☆42Updated 2 years ago
- How Much Position Information Do Convolutional Neural Networks Encode?☆11Updated 4 years ago
- Implementation for Context-Gated Convolution☆60Updated 4 years ago
- [CVPR 2024] Exploring Orthogonality in Open World Object Detection☆55Updated 6 months ago
- Scattering Vision Transformer☆53Updated last year
- [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction☆55Updated 2 years ago
- ☆78Updated 2 years ago
- [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training☆78Updated 2 years ago
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆84Updated 7 months ago
- [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"☆97Updated 3 years ago
- ☆149Updated last year