Qualcomm-AI-research / skip-attentionLinks
☆21Updated last year
Alternatives and similar repositories for skip-attention
Users that are interested in skip-attention are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation of ResFormer: Scaling ViTs with Multi-Resolution Training, CVPR2023☆29Updated 2 years ago
 - ☆32Updated 3 years ago
 - The official implementation for ALOFT (CVPR 2023).☆57Updated 2 years ago
 - This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer☆55Updated 3 years ago
 - Trainable Highly-expressive Activation Functions. ECCV 2024☆38Updated 8 months ago
 - This is an official code for UniConvNet on ICCV 2025☆30Updated 2 months ago
 - A Close Look at Spatial Modeling: From Attention to Convolution☆91Updated 2 years ago
 - ☆43Updated 2 years ago
 - PyTorch code for Diffusion Mechanism in Neural Network: Theory and Applications☆40Updated last year
 - [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆83Updated 6 months ago
 - ☆37Updated 2 years ago
 - CVPR2024 highlight.☆13Updated last year
 - ☆59Updated last year
 - [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆56Updated last year
 - ☆151Updated last year
 - ☆68Updated last year
 - Vision Transformers with Hierarchical Attention☆102Updated last month
 - Adaptive Split-Fusion Transformer (ICME 2023 Oral)☆17Updated last year
 - Implementation of HAT https://arxiv.org/pdf/2204.00993☆51Updated last year
 - [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction☆55Updated 2 years ago
 - How Much Position Information Do Convolutional Neural Networks Encode?☆11Updated 4 years ago
 - (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆106Updated 2 years ago
 - ☆31Updated last year
 - EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm☆34Updated 3 years ago
 - Official code release of our paper "FViT: A Focal Vision Transformer with Gabor Filter"☆18Updated 2 months ago
 - Code for paper " LST-Net: Learning a Convolutional Neural Network with a Learnable Sparse Transform" appeared in ECCV'20☆10Updated 4 years ago
 - [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"☆97Updated 3 years ago
 - Switchable Online Knowledge Distillation☆19Updated last year
 - ☆61Updated 2 years ago
 - PyTorch implementation of PaCa-ViT (CVPR'23)☆33Updated 2 years ago