Alternatives and similar repositories for PrimalAttention

Users that are interested in PrimalAttention are comparing it to the libraries listed below

• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆96Updated last year
• Adamdad / rational_kat_cu
  ☆77Updated 10 months ago
• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆81Updated last year
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆67Updated 2 years ago
• tnbar / tednet
  TedNet: A Pytorch Toolkit for Tensor Decomposition Networks
  ☆96Updated 3 years ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆231Updated last month
• rishikksh20 / ResMLP-pytorch
  ResMLP: Feedforward networks for image classification with data-efficient training
  ☆45Updated 4 years ago
• kschwethelm / HyperbolicCV
  ICLR 2024 | Fully Hyperbolic Convolutional Neural Networks for Computer Vision | Official Implementation
  ☆77Updated last year
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆46Updated last year
• karttikeya / minREV
  A simple minimal implementation of Reversible Vision Transformers
  ☆126Updated last year
• KingJamesSong / DifferentiableSVD
  A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance P…
  ☆79Updated 2 years ago
• Itamarzimm / UnifiedImplicitAttnRepr
  [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation
  ☆47Updated 9 months ago
• badripatro / mamba360
  State Space Models
  ☆71Updated last year
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆90Updated 2 years ago
• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆74Updated 3 years ago
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆57Updated last year
• nblt / F-SAM
  [CVPR 2024] Friendly Sharpness-Aware Minimization
  ☆34Updated last year
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆81Updated 2 years ago
• NVlabs / ConvSSM
  ☆69Updated last year
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆89Updated last year
• MzeroMiko / mamba-mini
  An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…
  ☆99Updated 2 months ago
• jacklishufan / Mamba-ND
  Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data
  ☆65Updated last year
• Felix-Petersen / difftopk
  Differentiable Top-k Classification Learning
  ☆90Updated 2 years ago
• willGuimont / learnable_fourier_positional_encoding
  Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
  ☆55Updated last year
• ziyuwwang / DynaMixer
  ☆27Updated 3 years ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆139Updated 6 months ago
• pprp / Vision-Mamba-CIFAR10
  ☆23Updated last year
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆44Updated last year
• eric-ai-lab / PEViT
  Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"
  ☆105Updated 2 years ago
• MingSun-Tse / Awesome-Efficient-ViT
  Recent Advances on Efficient Vision Transformers
  ☆55Updated 2 years ago