Alternatives and similar repositories for performer:

Users that are interested in performer are comparing it to the libraries listed below

• simon-larsson / keras-swa
  Simple stochastic weight averaging callback for Keras
  ☆63Updated 3 years ago
• wilile26811249 / Fastformer-PyTorch
  Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."
  ☆134Updated 3 years ago
• teddykoker / performer
  Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/
  ☆37Updated 4 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆160Updated last year
• lucidrains / fast-transformer-pytorch
  Implementation of Fast Transformer in Pytorch
  ☆173Updated 3 years ago
• sayakpaul / MLP-Mixer-CIFAR10
  Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.
  ☆56Updated 2 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆105Updated 4 years ago
• pseeth / autoclip
  Adaptive Gradient Clipping
  ☆130Updated 2 years ago
• rasbt / cyclemoid-pytorch
  Cyclemoid implementation for PyTorch
  ☆89Updated 3 years ago
• ayulockin / DataAugmentationTF
  Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.
  ☆34Updated 4 years ago
• beresandras / contrastive-classification-keras
  Implementation of self-supervised image-level contrastive pretraining methods using Keras.
  ☆70Updated 3 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆70Updated 2 years ago
• CyberZHG / keras-lookahead
  Lookahead mechanism for optimizers in Keras.
  ☆49Updated 3 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆78Updated 2 months ago
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆37Updated 3 years ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆22Updated 2 years ago
• lucidrains / nystrom-attention
  Implementation of Nyström Self-attention, from the paper Nyströmformer
  ☆131Updated last month
• Ximilar-com / tf-metric-learning
  Minimalistic TensorFlow2+ deep metric/similarity learning library with loss functions, miners, and utils as embedding projector.
  ☆37Updated 2 years ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆63Updated 3 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago
• andreped / GradientAccumulator
  Accumulated Gradients for TensorFlow 2
  ☆53Updated last year
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 3 years ago
• 4uiiurz1 / keras-cosine-annealing
  Keras implementation of Cosine Annealing Scheduler
  ☆44Updated 5 years ago
• sayakpaul / Sharpness-Aware-Minimization-TensorFlow
  Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.
  ☆60Updated 3 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated last year
• seongminp / transformers-into-vaes
  Code for "Finetuning Pretrained Transformers into Variational Autoencoders"
  ☆39Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆73Updated 2 years ago