LukasHedegaard / continual-transformersLinks
Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]
☆28Updated last year
Alternatives and similar repositories for continual-transformers
Users that are interested in continual-transformers are comparing it to the libraries listed below
Sorting:
- A Python library for Continual Inference Networks in PyTorch☆52Updated 3 months ago
- Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".☆44Updated 3 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆118Updated 4 years ago
- Code for the paper PermuteFormer☆42Updated 3 years ago
- Implementation of Multistream Transformers in Pytorch☆54Updated 3 years ago
- This repository contains source codes for SoftCTC. Original paper can be found here: https://arxiv.org/abs/2212.02135☆19Updated 2 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆51Updated 3 years ago
- Relative Positional Encoding for Transformers with Linear Complexity☆64Updated 3 years ago
- A variant of Transformer-XL where the memory is updated not with a queue, but with attention☆49Updated 4 years ago
- A Pytorch Implementations for Various Vector Quantization Methods☆30Updated 3 years ago
- ☆73Updated 4 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆61Updated 3 years ago
- VIsually-Pivoted Audio and(N) Text☆22Updated 3 years ago
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- Discriminative Prototypes learned by Dynamic Time Warping (DTW) for Time Series Classification (TSC)☆32Updated 4 years ago
- Reference implementation of DecDTW in PyTorch (ICLR 2023)☆22Updated 2 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆55Updated 2 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 6 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆87Updated 3 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Updated 2 years ago
- ☆17Updated 2 years ago
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19Updated last month
- Layerwise Batch Entropy Regularization☆23Updated 2 years ago
- Composing General Audio Representation by Fusing Multilayer Features of a Pre-trained Model☆26Updated 2 years ago
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Updated last year
- Implementations of various linear RNN layers using pytorch and triton☆53Updated last year
- Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.☆74Updated 2 years ago
- ICML 21 - Voice2Series: Adversarial Reprogramming Acoustic Models for Time Series Classification☆73Updated last year
- PyTorch implementation of CorInfoMax☆21Updated 2 years ago
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆66Updated 2 years ago