Alternatives and similar repositories for performer:

Users that are interested in performer are comparing it to the libraries listed below

• simon-larsson / keras-swa
  Simple stochastic weight averaging callback for Keras
  ☆63Updated 3 years ago
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆70Updated 2 years ago
• wilile26811249 / Fastformer-PyTorch
  Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."
  ☆134Updated 3 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆158Updated 11 months ago
• 4uiiurz1 / keras-cosine-annealing
  Keras implementation of Cosine Annealing Scheduler
  ☆44Updated 4 years ago
• sayakpaul / MLP-Mixer-CIFAR10
  Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.
  ☆54Updated 2 years ago
• hendrycks / GELUs
  A smoother activation function (undergrad code)
  ☆108Updated 4 years ago
• sayakpaul / Sharpness-Aware-Minimization-TensorFlow
  Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.
  ☆60Updated 3 years ago
• andreped / GradientAccumulator
  Accumulated Gradients for TensorFlow 2
  ☆53Updated 11 months ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆67Updated 2 weeks ago
• lucidrains / nystrom-attention
  Implementation of Nyström Self-attention, from the paper Nyströmformer
  ☆124Updated last year
• beresandras / contrastive-classification-keras
  Implementation of self-supervised image-level contrastive pretraining methods using Keras.
  ☆69Updated 3 years ago
• rasbt / cyclemoid-pytorch
  Cyclemoid implementation for PyTorch
  ☆87Updated 2 years ago
• teddykoker / performer
  Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/
  ☆37Updated 4 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated last year
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆93Updated 4 years ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆221Updated last year
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆117Updated 3 years ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆22Updated 2 years ago
• lucidrains / ETSformer-pytorch
  Implementation of ETSformer, state of the art time-series Transformer, in Pytorch
  ☆151Updated last year
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• OverLordGoldDragon / keras-adamw
  Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
  ☆167Updated 3 years ago
• lorenlugosch / pytorch_HMM
  HMMs in PyTorch
  ☆135Updated 3 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆61Updated 2 years ago
• rycolab / entropyRegularization
  Code for Generalized Entropy Regularization paper
  ☆14Updated 4 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆105Updated 3 years ago
• lucidrains / fast-transformer-pytorch
  Implementation of Fast Transformer in Pytorch
  ☆172Updated 3 years ago
• amarczew / pytorch_model_summary
  ☆52Updated 4 years ago
• jiaweizzhao / ZerO-initialization
  ☆72Updated 2 years ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆61Updated 2 years ago