LukasHedegaard / continual-transformers
Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]
☆28Updated last year
Alternatives and similar repositories for continual-transformers:
Users that are interested in continual-transformers are comparing it to the libraries listed below
- A Python library for Continual Inference Networks in PyTorch☆49Updated last year
- Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".☆44Updated 3 years ago
- Code for the paper PermuteFormer☆42Updated 3 years ago
- A PyTorch implementation of SimSiam based on CVPR 2021 paper "Exploring Simple Siamese Representation Learning"☆10Updated 3 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆111Updated 4 years ago
- Codes for paper <InteL-VAEs: Adding Inductive Biases to VariationalAuto-Encoders via Intermediary Latents>.☆19Updated 3 years ago
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- This repository contains source codes for SoftCTC. Original paper can be found here: https://arxiv.org/abs/2212.02135☆19Updated last year
- STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION☆16Updated 6 years ago
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19Updated this week
- ☆72Updated 3 years ago
- VIsually-Pivoted Audio and(N) Text☆22Updated 2 years ago
- An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.☆10Updated 2 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 3 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 5 years ago
- Implementations of various linear RNN layers using pytorch and triton☆49Updated last year
- Implementation of Multistream Transformers in Pytorch☆53Updated 3 years ago
- Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"☆25Updated last year
- Relative Positional Encoding for Transformers with Linear Complexity☆62Updated 2 years ago
- Code for the C2KD paper (ICASSP 2023)☆19Updated last year
- ☆66Updated 2 years ago
- Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch☆51Updated 3 years ago
- Torch-based tool for quantizing high-dimensional vectors using additive codebooks☆51Updated 2 years ago
- A Pytorch Implementations for Various Vector Quantization Methods☆27Updated 3 years ago
- Reference implementation of DecDTW in PyTorch (ICLR 2023)☆21Updated last year
- Official implementation of FOP method as described in "Fusion and Orthogonal Projection for Improved Face-Voice Association"☆17Updated last year
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆60Updated 2 years ago
- Vector Quantized Autoregressive Predictive Coding (VQ-APC)☆35Updated 4 years ago