Alternatives and similar repositories for Performer-Pytorch:

Users that are interested in Performer-Pytorch are comparing it to the libraries listed below

• lioutasb / TaLKConvolutions
  Official PyTorch implementation of Time-aware Large Kernel (TaLK) Convolutions (ICML 2020)
  ☆29Updated 4 years ago
• ZichenMiao / L3Net
  ICLR 2021 (spotlight): Graph Convolution with Low-rank Learnable Local Filters
  ☆15Updated 4 years ago
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆57Updated 3 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆40Updated 3 years ago
• lucidrains / AoA-pytorch
  A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering
  ☆40Updated 4 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆57Updated last year
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆59Updated 4 years ago
• davidsvy / cosformer-pytorch
  Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".
  ☆44Updated 3 years ago
• Chenglin-Yang / LESA
  Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms
  ☆20Updated 3 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆118Updated 3 years ago
• guoyongcs / NATv2
  Implementation for NATv2.
  ☆23Updated 3 years ago
• google-research / noisy-fewshot-learning
  ☆23Updated 4 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆35Updated 3 years ago
• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆35Updated 4 years ago
• deep-spin / mcan-vqa-continuous-attention
  ☆22Updated 4 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆23Updated 5 years ago
• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 4 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 4 years ago
• princetonvisualai / SPICE-U
  ☆11Updated 4 years ago
• biswajitsc / sparse-embed
  Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020
  ☆20Updated 4 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• btma48 / AutoLA
  Code of our Neurips2020 paper "Auto Learning Attention", coming soon
  ☆21Updated 3 years ago
• LIJUNYI95 / SuperAdam
  Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'
  ☆17Updated 3 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• yhlleo / DWC-GAN
  [ACM MM 2020] DWC-GAN.
  ☆32Updated 3 years ago
• EvgenyKashin / non-leaking-conv
  Implementation of Spectral Leakage and Rethinking the Kernel Size in CNNs in Pytorch
  ☆14Updated 3 years ago
• rishikksh20 / rectified-linear-attention
  Sparse Attention with Linear Units
  ☆17Updated 3 years ago
• doerlbh / UnsupervisedAttentionMechanism
  Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".
  ☆21Updated 3 years ago