BobMcDear / vit-pytorch

Related projects: ⓘ

• BobMcDear / simsiam-pytorch
  PyTorch implementation of SimSiam
  ☆8Updated last year
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆56Updated 10 months ago
• srush / mamba-primer
  ☆35Updated 5 months ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated last year
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆58Updated 2 years ago
• njmarko / graph-transformer-psiml
  Transformer implemented with graph attention network (GAT) layers from PyTorch Geometric
  ☆15Updated 2 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch
  ☆37Updated 4 months ago
• BobMcDear / efficientnet-pytorch
  PyTorch implementation of EfficientNet
  ☆9Updated last year
• gregorbachmann / scaling_mlps
  ☆48Updated 3 months ago
• wileyw / DeepLearningDemos
  Deep Learning Experiment Code.
  ☆19Updated last month
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆85Updated last month
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆15Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆45Updated last month
• lucidrains / hyena-pytorch
  ☆23Updated this week
• SEU-VIPGroup / Equiangular-Basis-Vectors
  ☆35Updated last year
• ShivamRajSharma / Transformer-Architectures-From-Scratch
  Implementation of transformers based architecture in PyTorch.
  ☆48Updated 3 years ago
• sayakpaul / cait-tf
  Implementation of CaiT models in TensorFlow and ImageNet-1k checkpoints. Includes code for inference and fine-tuning.
  ☆12Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆50Updated 10 months ago
• radarFudan / mamba-minimal-jax
  ☆28Updated last week
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆23Updated 2 months ago
• elliotwaite / pytorch-hooks-tutorial
  Examples of using PyTorch hooks, as covered in my YouTube tutorial video.
  ☆32Updated 10 months ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆35Updated 2 years ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆74Updated 7 months ago
• tech-srl / layer_norm_expressivity_role
  Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)
  ☆43Updated last year
• lucidrains / simplicial-attention
  ☆20Updated this week
• y0ast / pytorch-snippets
  Collection of snippets for PyTorch users
  ☆26Updated 2 years ago
• microsoft / fnl_paper
  Factorized Neural Layers
  ☆27Updated last year
• lucidrains / spatial-rmsnorm
  ☆11Updated this week
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆28Updated last week
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆83Updated 2 months ago