Alternatives and similar repositories for performer

Users that are interested in performer are comparing it to the libraries listed below

• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆106Updated 4 years ago
• simon-larsson / keras-swa
  Simple stochastic weight averaging callback for Keras
  ☆63Updated 3 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• lucidrains / nystrom-attention
  Implementation of Nyström Self-attention, from the paper Nyströmformer
  ☆135Updated last month
• sayakpaul / MLP-Mixer-CIFAR10
  Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.
  ☆56Updated 2 years ago
• wilile26811249 / Fastformer-PyTorch
  Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."
  ☆134Updated 3 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆71Updated 2 years ago
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆74Updated 2 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆161Updated last year
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆79Updated 2 months ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆23Updated 2 years ago
• lucidrains / ETSformer-pytorch
  Implementation of ETSformer, state of the art time-series Transformer, in Pytorch
  ☆153Updated last year
• teddykoker / performer
  Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/
  ☆37Updated 4 years ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆41Updated 4 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 3 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆63Updated 3 years ago
• GillesVandewiele / covid19-mrna-degradation-prediction
  Fourth place solution to the "OpenVaccine: COVID-19 mRNA Vaccine Degradation Prediction" organized by Stanford University and Kaggle
  ☆20Updated 4 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆131Updated 11 months ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 9 months ago
• Selozhd / FNet-tensorflow
  Tensorflow Implementation of "FNet: Mixing Tokens with Fourier Transforms."
  ☆22Updated 3 years ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆74Updated 2 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆78Updated 4 years ago
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆27Updated 4 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆117Updated 3 years ago
• beresandras / contrastive-classification-keras
  Implementation of self-supervised image-level contrastive pretraining methods using Keras.
  ☆70Updated 3 years ago
• lucidrains / local-attention-flax
  Local Attention - Flax module for Jax
  ☆22Updated 3 years ago
• lorenlugosch / pytorch_HMM
  HMMs in PyTorch
  ☆138Updated 4 years ago
• pseeth / autoclip
  Adaptive Gradient Clipping
  ☆132Updated 2 years ago