Alternatives and similar repositories for performer

Users that are interested in performer are comparing it to the libraries listed below

• lucidrains / compositional-attention-pytorch
  Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…
  ☆51Updated 3 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆63Updated 3 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 3 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 3 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 4 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆50Updated 3 years ago
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆74Updated 2 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆35Updated 2 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆34Updated 4 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆100Updated 2 years ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆44Updated 2 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• lucidrains / product-key-memory
  Standalone Product Key Memory module in Pytorch - for augmenting Transformer models
  ☆78Updated 10 months ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆70Updated 2 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆66Updated last year
• lucidrains / local-attention-flax
  Local Attention - Flax module for Jax
  ☆22Updated 4 years ago
• ColinQiyangLi / AdaCat
  AdaCat
  ☆49Updated 2 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆61Updated 3 years ago
• nestordemeure / flaxOptimizers
  A collection of optimizers, some arcane others well known, for Flax.
  ☆29Updated 3 years ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆58Updated last year
• lucidrains / all-normalization-transformer
  A simple Transformer where the softmax has been replaced with normalization
  ☆20Updated 4 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆105Updated 3 years ago
• lucidrains / adjacent-attention-network
  Graph neural network message passing reframed as a Transformer with local attention
  ☆69Updated 2 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• tk-rusch / LEM
  Official code for Long Expressive Memory (ICLR 2022, Spotlight)
  ☆69Updated 3 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆45Updated last year
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 3 years ago