Alternatives and similar repositories for Performer-Pytorch:

Users that are interested in Performer-Pytorch are comparing it to the libraries listed below

• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆35Updated 4 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆40Updated 3 years ago
• davidsvy / cosformer-pytorch
  Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".
  ☆44Updated 3 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆23Updated 5 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆118Updated 3 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• Chenglin-Yang / LESA
  Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms
  ☆20Updated 3 years ago
• lucidrains / AoA-pytorch
  A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering
  ☆41Updated 4 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆35Updated 3 years ago
• LukasHedegaard / continual-transformers
  Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]
  ☆28Updated last year
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago
• ZichenMiao / L3Net
  ICLR 2021 (spotlight): Graph Convolution with Low-rank Learnable Local Filters
  ☆15Updated 4 years ago
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆59Updated 4 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 2 years ago
• lioutasb / TaLKConvolutions
  Official PyTorch implementation of Time-aware Large Kernel (TaLK) Convolutions (ICML 2020)
  ☆29Updated 4 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆60Updated last year
• lucidrains / omninet-pytorch
  Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
  ☆57Updated 4 years ago
• intersun / CoDIR
  Code for EMNLP 2020 paper CoDIR
  ☆41Updated 2 years ago
• LibertFan / MAN
  Mask Attention Networks: Rethinking and Strengthen Transformer in NAACL2021
  ☆14Updated 3 years ago
• kuixu / Linear-Multihead-Attention
  Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
  ☆75Updated 4 years ago
• clovaai / group-transformer
  Official code for Group-Transformer (Scale down Transformer by Grouping Features for a Lightweight Character-level Language Model, COLING…
  ☆25Updated 4 years ago
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆25Updated 3 years ago
• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 4 years ago
• RAIVNLab / LLC
  ☆13Updated 3 years ago
• google-research / noisy-fewshot-learning
  ☆23Updated 4 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• princetonvisualai / SPICE-U
  ☆11Updated 4 years ago
• Noahs-ARK / RFA
  ☆33Updated 3 years ago
• LIJUNYI95 / SuperAdam
  Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'
  ☆17Updated 3 years ago