robflynnyh / hydra-linear-attentionLinks
Implementation of: Hydra Attention: Efficient Attention with Many Heads (https://arxiv.org/abs/2209.07484)
☆14Updated 2 years ago
Alternatives and similar repositories for hydra-linear-attention
Users that are interested in hydra-linear-attention are comparing it to the libraries listed below
Sorting:
- [ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆86Updated 5 months ago
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆95Updated 2 weeks ago
- [CVPR'23 & TPAMI'25] Hard Patches Mining for Masked Image Modeling & Bootstrap Masked Visual Modeling via Hard Patch Mining☆103Updated 6 months ago
- Official repository of Slide-Transformer (CVPR2023)☆172Updated last year
- [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference☆30Updated last year
- Pytorch Implementation for CVPR 2024 paper: Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation☆54Updated 2 months ago
- ☆47Updated last year
- Collect papers about Mamba (a selective state space model).☆14Updated last year
- Official implementation of CVPR 2024 paper "Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers".☆39Updated 3 months ago
- [CVPR 2024] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities☆99Updated last year
- GroupMamba: Parameter-Efficient and Accurate Group Visual State Space Model [CVPR -2025]☆123Updated 7 months ago
- ☆74Updated 8 months ago
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆68Updated 7 months ago
- ☆152Updated last year
- PyTorch reimplementation of FlexiViT: One Model for All Patch Sizes☆62Updated last year
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆219Updated last month
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆106Updated 2 years ago
- iFormer: Inception Transformer☆246Updated 2 years ago
- A repository for DenseSSMs☆89Updated last year
- [NeurIPS2024 Spotlight] The official implementation of MambaTree: Tree Topology is All You Need in State Space Model☆102Updated last year
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆52Updated 3 years ago
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆122Updated 6 months ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆81Updated last year
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆83Updated 6 months ago
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆64Updated last year
- ☆62Updated 2 years ago
- ☆85Updated 2 years ago
- Official Implementation of DiffCLIP: Differential Attention Meets CLIP☆46Updated 7 months ago
- This repository contains the pytorch code for our work IEEE ISBI 2024 paper "ConvLoRA and AdaBN Based Domain Adaptation via Self-Training…☆88Updated last year
- List of papers related to State Space Models (Mamba) in Vision.☆38Updated last year