Alternatives and similar repositories for PrimalAttention:

Users that are interested in PrimalAttention are comparing it to the libraries listed below

• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆71Updated 2 years ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆92Updated last year
• sndnyang / Diffusion_ViT
  PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"
  ☆48Updated 2 years ago
• Adamdad / rational_kat_cu
  ☆57Updated 2 months ago
• MambaMixer / M2
  ☆48Updated last year
• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆80Updated last year
• facebookresearch / asym-siam
  PyTorch implementation of Asymmetric Siamese (https://arxiv.org/abs/2204.00613)
  ☆99Updated 2 years ago
• rishikksh20 / ResMLP-pytorch
  ResMLP: Feedforward networks for image classification with data-efficient training
  ☆42Updated 3 years ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 4 months ago
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆30Updated last year
• IBM / RegionViT
  open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689
  ☆51Updated 3 years ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆105Updated last year
• badripatro / mamba360
  State Space Models
  ☆67Updated 11 months ago
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated last month
• Itamarzimm / UnifiedImplicitAttnRepr
  [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation
  ☆42Updated last month
• TomerRonen34 / mixed-resolution-vit
  ☆50Updated last year
• OliverRensu / ARM
  This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆73Updated 9 months ago
• xinliu20 / MEC
  ☆44Updated 2 years ago
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆94Updated last year
• MengLcool / AdaViT
  [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".
  ☆52Updated 2 years ago
• nblt / F-SAM
  [CVPR 2024] Friendly Sharpness-Aware Minimization
  ☆32Updated 5 months ago
• ma-xu / FCViT
  A Close Look at Spatial Modeling: From Attention to Convolution
  ☆91Updated 2 years ago
• jacklishufan / Mamba-ND
  Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data
  ☆58Updated 9 months ago
• haofanwang / awesome-mlp-papers
  Recent Advances in MLP-based Models (MLP is all you need!)
  ☆114Updated 2 years ago
• willGuimont / learnable_fourier_positional_encoding
  Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
  ☆46Updated 6 months ago
• locuslab / convmixer-cifar10
  Simple CIFAR-10 classification with ConvMixer
  ☆43Updated 3 years ago
• ziyuwwang / DynaMixer
  ☆27Updated 2 years ago
• shoaibahmed / blockwise_ssl
  Repository containing code for blockwise SSL training
  ☆29Updated 6 months ago
• karttikeya / minREV
  A simple minimal implementation of Reversible Vision Transformers
  ☆124Updated last year
• mlvlab / TokenMixup
  Official pytorch implementation of NeurIPS 2022 paper, TokenMixup
  ☆48Updated 2 years ago