Alternatives and similar repositories for block-recurrent-transformer:

Users that are interested in block-recurrent-transformer are comparing it to the libraries listed below

• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆115Updated 4 years ago
• RMichaelSwan / MogrifierLSTM
  A quick walk-through of the innards of LSTMs and a naive implementation of the Mogrifier LSTM paper in PyTorch
  ☆76Updated 4 years ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆99Updated 2 years ago
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆59Updated 4 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆60Updated last year
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆160Updated last year
• bojone / rnn
  一些RNN的实现
  ☆49Updated 2 years ago
• lucidrains / ETSformer-pytorch
  Implementation of ETSformer, state of the art time-series Transformer, in Pytorch
  ☆152Updated last year
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆64Updated 11 months ago
• microsoft / EfficientLongSequenceModeling
  ☆51Updated 2 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆187Updated 2 years ago
• Noahs-ARK / RFA
  ☆33Updated 3 years ago
• deep-spin / infinite-former
  ☆64Updated 7 months ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆55Updated 3 years ago
• alex-matton / causal-transformer-decoder
  ☆75Updated 4 years ago
• lucidrains / adjacent-attention-network
  Graph neural network message passing reframed as a Transformer with local attention
  ☆68Updated 2 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆70Updated last year
• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆128Updated 4 years ago
• OpenVLG / DELLA
  Official code for the NAACL 2022 paper "Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text…
  ☆35Updated 2 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆204Updated last year
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆52Updated 2 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• CAMTL / CA-MTL
  Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
  ☆56Updated 3 years ago
• libeineu / ODE-Transformer
  This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generati…
  ☆30Updated 2 years ago
• lucidrains / compressive-transformer-pytorch
  Pytorch implementation of Compressive Transformers, from Deepmind
  ☆156Updated 3 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆119Updated last year
• Doraemonzzz / hgru2-pytorch
  ☆23Updated 6 months ago
• aliutkus / spe
  Relative Positional Encoding for Transformers with Linear Complexity
  ☆62Updated 2 years ago
• Yuanhy1997 / SeqDiffuSeq
  Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation [NAACL 2024]
  ☆93Updated last year