Alternatives and similar repositories for causal-transformer-decoder:

Users that are interested in causal-transformer-decoder are comparing it to the libraries listed below

• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆63Updated 3 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆99Updated 2 years ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆78Updated 2 months ago
• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆115Updated 4 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆104Updated 3 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 3 years ago
• seongminp / transformers-into-vaes
  Code for "Finetuning Pretrained Transformers into Variational Autoencoders"
  ☆39Updated 2 years ago
• ischlag / Fast-Weight-Memory-public
  Official code repository of the paper Learning Associative Inference Using Fast Weight Memory by Schlag et al.
  ☆28Updated 4 years ago
• lucidrains / compressive-transformer-pytorch
  Pytorch implementation of Compressive Transformers, from Deepmind
  ☆157Updated 3 years ago
• sarthmit / Compositional-Attention
  Code to reproduce the results for Compositional Attention
  ☆60Updated 2 years ago
• lucidrains / memory-transformer-xl
  A variant of Transformer-XL where the memory is updated not with a queue, but with attention
  ☆48Updated 4 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆118Updated 3 years ago
• ctlllll / SGConv
  ☆164Updated 2 years ago
• revsic / jax-variational-diffwave
  Jax/Flax implementation of Variational-DiffWave.
  ☆40Updated 3 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 3 years ago
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆73Updated 2 years ago
• teddykoker / performer
  Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/
  ☆37Updated 4 years ago
• lucidrains / product-key-memory
  Standalone Product Key Memory module in Pytorch - for augmenting Transformer models
  ☆78Updated 8 months ago
• kylehkhsu / latent_quantization
  ☆37Updated last year
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated last year
• distsup / DistSup
  Representation learning for NLP @ JSALT19
  ☆38Updated 4 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆160Updated last year
• jaywalnut310 / Vector-Quantized-Autoencoders
  Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"
  ☆14Updated 6 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• microsoft / EfficientLongSequenceModeling
  ☆51Updated 2 years ago
• machelreid / diffuser
  DiffusER: Discrete Diffusion via Edit-based Reconstruction (Reid, Hellendoorn & Neubig, 2022)
  ☆54Updated 2 years ago
• rosinality / imputer-pytorch
  Implementation of Imputer: Sequence Modelling via Imputation and Dynamic Programming in PyTorch
  ☆58Updated 4 years ago