yingyichen-cyy / PrimalAttentionLinks
(NeurIPS 2023) PyTorch implementation of "Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation"
☆19Updated 9 months ago
Alternatives and similar repositories for PrimalAttention
Users that are interested in PrimalAttention are comparing it to the libraries listed below
Sorting:
- Transformers w/o Attention, based fully on MLPs☆93Updated last year
- A simple minimal implementation of Reversible Vision Transformers☆125Updated last year
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆111Updated last year
- [CVPR 2024] Friendly Sharpness-Aware Minimization☆33Updated 8 months ago
- ☆31Updated 3 years ago
- “SURE: SUrvey REcipes for building reliable and robust deep networks” (CVPR 2024) & (ECCV 2024 OOD-CV Challenge Winner)☆63Updated 8 months ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆224Updated last year
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"☆72Updated 2 years ago
- ☆45Updated 2 years ago
- ☆69Updated 5 months ago
- Hyperbolic Vision Transformers: Combining Improvements in Metric Learning | Official repository☆197Updated 3 years ago
- ☆66Updated 8 months ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆115Updated 2 years ago
- Two-way Multi-Label Loss☆34Updated 2 years ago
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆58Updated last year
- Differentiable Top-k Classification Learning☆83Updated 2 years ago
- State Space Models☆68Updated last year
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆144Updated 6 months ago
- Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"☆104Updated last year
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆51Updated 9 months ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆43Updated 4 years ago
- A simple cross attention that updates both the source and target in one step☆172Updated last year
- PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)☆144Updated 2 years ago
- An official code release of the paper RGB no more: Minimally Decoded JPEG Vision Transformers☆55Updated 2 years ago
- Whitening for Self-Supervised Representation Learning | Official repository☆129Updated 2 years ago
- Sequencer: Deep LSTM for Image Classification☆143Updated 2 years ago
- PyTorch reimplementation of FlexiViT: One Model for All Patch Sizes☆62Updated last year
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆304Updated 3 months ago
- MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248☆55Updated last year
- The code of "Improving Deep Regression with Ordinal Entropy" in ICLR 2023☆51Updated last year