Alternatives and similar repositories for PrimalAttention:

Users that are interested in PrimalAttention are comparing it to the libraries listed below

• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆80Updated last year
• Adamdad / rational_kat_cu
  ☆53Updated last month
• sndnyang / Diffusion_ViT
  PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"
  ☆48Updated 2 years ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆52Updated last year
• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆71Updated 2 years ago
• ziyuwwang / DynaMixer
  ☆27Updated 2 years ago
• rishikksh20 / ResMLP-pytorch
  ResMLP: Feedforward networks for image classification with data-efficient training
  ☆42Updated 3 years ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 3 months ago
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆40Updated 11 months ago
• fundamentalvision / UniGrad
  ☆32Updated 2 years ago
• Haochen-Wang409 / HPM
  [CVPR'23] Hard Patches Mining for Masked Image Modeling
  ☆90Updated last year
• badripatro / mamba360
  State Space Models
  ☆66Updated 10 months ago
• IBM / RegionViT
  open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689
  ☆51Updated 3 years ago
• mlvlab / TokenMixup
  Official pytorch implementation of NeurIPS 2022 paper, TokenMixup
  ☆48Updated 2 years ago
• Itamarzimm / UnifiedImplicitAttnRepr
  [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation
  ☆40Updated 2 weeks ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆93Updated 11 months ago
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆29Updated last year
• NVlabs / ConvSSM
  ☆65Updated 4 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated 11 months ago
• Haochen-Wang409 / DropPos
  [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
  ☆61Updated 10 months ago
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆81Updated last year
• ethanbar11 / ssm_2d
  More dimensions = More fun
  ☆21Updated 7 months ago
• MambaMixer / M2
  ☆47Updated 11 months ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆60Updated last year
• jiachenzhu / VCR
  Variance Covariance Regularization
  ☆14Updated last year
• UMass-Embodied-AGI / Mod-Squad
  ☆84Updated last year
• xinliu20 / MEC
  ☆42Updated 2 years ago
• willGuimont / learnable_fourier_positional_encoding
  Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
  ☆45Updated 5 months ago
• jacklishufan / Mamba-ND
  Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data
  ☆58Updated 8 months ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆104Updated last year