Alternatives and similar repositories for performer:

Users that are interested in performer are comparing it to the libraries listed below

• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆57Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆33Updated 4 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• lucidrains / all-normalization-transformer
  A simple Transformer where the softmax has been replaced with normalization
  ☆19Updated 4 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• lucidrains / compositional-attention-pytorch
  Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…
  ☆50Updated 2 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆63Updated 3 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 4 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆99Updated 2 years ago
• ClashLuke / PerfTorch
  High performance pytorch modules
  ☆18Updated 2 years ago
• lucidrains / deep-linear-network
  A simple implementation of a deep linear Pytorch module
  ☆19Updated 4 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 3 years ago
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆73Updated 2 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated 2 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆35Updated 3 years ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• nestordemeure / flaxOptimizers
  A collection of optimizers, some arcane others well known, for Flax.
  ☆29Updated 3 years ago
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 3 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• lucidrains / product-key-memory
  Standalone Product Key Memory module in Pytorch - for augmenting Transformer models
  ☆78Updated 8 months ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆80Updated 3 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆160Updated last year
• apsarath / NRU
  ☆22Updated 6 years ago
• liu-ziyin / NeurIPS_2020_Snake
  ☆31Updated 3 years ago
• Popgun-Labs / PopGen
  A generative modelling toolkit for PyTorch.
  ☆70Updated 3 years ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year