Alternatives and similar repositories for vit-pytorch

Users that are interested in vit-pytorch are comparing it to the libraries listed below

• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆59Updated last year
• Doraemonzzz / hgru-pytorch
  ☆27Updated last year
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆15Updated 2 years ago
• princeton-nlp / DataMUX
  [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks
  ☆60Updated 2 years ago
• wileyw / DeepLearningDemos
  Deep Learning Experiment Code.
  ☆19Updated 3 months ago
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆39Updated last year
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆63Updated 3 years ago
• bdusell / stack-attention
  Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"
  ☆17Updated last year
• Doraemonzzz / hgru2-pytorch
  ☆23Updated last year
• njmarko / graph-transformer-psiml
  Transformer implemented with graph attention network (GAT) layers from PyTorch Geometric
  ☆17Updated 3 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated last year
• causalNLP / causal-cite
  Codes for the paper "CausalCite: A Causal Formulation of Paper Citations" (2023)
  ☆17Updated last year
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆43Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated 4 months ago
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆55Updated 2 years ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆95Updated last year
• microsoft / fnl_paper
  Factorized Neural Layers
  ☆30Updated 2 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 4 years ago
• archinetai / vat-pytorch
  Virtual Adversarial Training (VAT) techniques in PyTorch
  ☆17Updated 3 years ago
• gregorbachmann / scaling_mlps
  ☆52Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆54Updated last year
• tech-srl / layer_norm_expressivity_role
  Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
  ☆57Updated last year
• SEU-VIPGroup / Equiangular-Basis-Vectors
  ☆34Updated 2 years ago
• hunar4321 / RLS-neural-net
  Recursive Leasting Squares (RLS) with Neural Network for fast learning
  ☆55Updated last year
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆99Updated last year
• CMU-IDeeL / CMU-IDeeL.github.io
  11-785 Introduction to Deep Learning (IDeeL) website with logistics and select course materials
  ☆67Updated last week
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• ShivamRajSharma / Transformer-Architectures-From-Scratch
  Implementation of transformers based architecture in PyTorch.
  ☆54Updated 4 years ago