dashstander / block-recurrent-transformer
Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)
☆84Updated 2 years ago
Alternatives and similar repositories for block-recurrent-transformer:
Users that are interested in block-recurrent-transformer are comparing it to the libraries listed below
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆111Updated 4 years ago
- [EMNLP'19] Summary for Transformer Understanding☆53Updated 5 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆97Updated last year
- code for Explicit Sparse Transformer☆60Updated last year
- A quick walk-through of the innards of LSTMs and a naive implementation of the Mogrifier LSTM paper in PyTorch☆74Updated 4 years ago
- ☆83Updated 5 years ago
- Learning to Encode Position for Transformer with Continuous Dynamical Model☆59Updated 4 years ago
- Implementation of ETSformer, state of the art time-series Transformer, in Pytorch☆152Updated last year
- Sequence Modeling with Structured State Spaces☆62Updated 2 years ago
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆160Updated last year
- 一些RNN的实现☆49Updated last year
- Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"☆70Updated last year
- Transformer-based Conditional Variational Autoencoder for Controllable Story Generation☆151Updated 2 years ago
- A pytorch &keras implementation and demo of Fastformer.☆187Updated 2 years ago
- Axial Positional Embedding for Pytorch☆70Updated last week
- Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data☆56Updated 3 years ago
- ☆72Updated 3 years ago
- ☆51Updated 2 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆125Updated 4 years ago
- Code for the paper "Query-Key Normalization for Transformers"☆37Updated 3 years ago
- This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generati…☆29Updated 2 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆118Updated 3 years ago
- Official code for the NAACL 2022 paper "Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text…☆35Updated 2 years ago
- Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch☆70Updated 4 years ago
- Graph neural network message passing reframed as a Transformer with local attention☆67Updated 2 years ago
- [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)☆119Updated 11 months ago
- Multi-head attention in PyTorch☆150Updated 5 years ago
- PyTorch implementation of Pay Attention to MLPs☆40Updated 3 years ago
- Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch☆37Updated 2 years ago
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆34Updated last year