yingyichen-cyy / PrimalAttention
(NeurIPS 2023) PyTorch implementation of "Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation"
☆19Updated 3 months ago
Alternatives and similar repositories for PrimalAttention:
Users that are interested in PrimalAttention are comparing it to the libraries listed below
- ☆44Updated 2 months ago
- PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"☆48Updated 2 years ago
- ☆64Updated 3 months ago
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆44Updated 4 months ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆70Updated 2 years ago
- [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference☆26Updated 10 months ago
- Transformers w/o Attention, based fully on MLPs☆92Updated 9 months ago
- ☆41Updated 2 years ago
- ☆27Updated 2 years ago
- Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …☆33Updated last year
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆44Updated last month
- State Space Models☆64Updated 8 months ago
- ☆21Updated 2 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆78Updated last year
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆103Updated last year
- “SURE: SUrvey REcipes for building reliable and robust deep networks” (CVPR 2024) & (ECCV 2024 OOD-CV Challenge Winner)☆55Updated 2 months ago
- Official pytorch implementation of NeurIPS 2022 paper, TokenMixup☆48Updated 2 years ago
- Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.☆34Updated 2 years ago
- This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆68Updated 7 months ago
- [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions☆60Updated 9 months ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- Towards Unified and Effective Domain Generalization☆29Updated last year
- ☆45Updated 10 months ago
- ☆42Updated last year
- ☆31Updated 2 years ago
- A simple minimal implementation of Reversible Vision Transformers☆120Updated 10 months ago
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Updated 2 years ago
- ☆25Updated 3 years ago
- Official Code for NeurIPS 2022 Paper: How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders☆57Updated last year
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆51Updated 2 years ago