Alternatives and similar repositories for performer

Users that are interested in performer are comparing it to the libraries listed below

• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆107Updated 4 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆161Updated last year
• lucidrains / nystrom-attention
  Implementation of Nyström Self-attention, from the paper Nyströmformer
  ☆135Updated 3 months ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• sayakpaul / MLP-Mixer-CIFAR10
  Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.
  ☆56Updated 3 years ago
• ctlllll / SGConv
  ☆163Updated 2 years ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆227Updated 2 years ago
• simon-larsson / keras-swa
  Simple stochastic weight averaging callback for Keras
  ☆63Updated 3 years ago
• lucidrains / ETSformer-pytorch
  Implementation of ETSformer, state of the art time-series Transformer, in Pytorch
  ☆153Updated last year
• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated 2 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 3 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆81Updated 4 months ago
• r0mainK / outperformer
  Code for scaling Transformers
  ☆26Updated 4 years ago
• jiaweizzhao / ZerO-initialization
  ☆74Updated 2 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆71Updated 2 years ago
• wilile26811249 / Fastformer-PyTorch
  Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."
  ☆134Updated 3 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆105Updated 4 years ago
• erksch / fnet-pytorch
  Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.
  ☆74Updated 2 years ago
• lucidrains / fast-transformer-pytorch
  Implementation of Fast Transformer in Pytorch
  ☆175Updated 3 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 4 years ago
• peerdavid / layerwise-batch-entropy
  Layerwise Batch Entropy Regularization
  ☆23Updated 2 years ago
• teddykoker / performer
  Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/
  ☆38Updated 4 years ago
• sgugger / hf_examples
  NLP Examples using the 🤗 libraries
  ☆41Updated 4 years ago
• ayulockin / DataAugmentationTF
  Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.
  ☆34Updated 4 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆100Updated 2 years ago
• rish-16 / aft-pytorch
  Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.
  ☆237Updated 3 years ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆64Updated 3 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated 2 years ago