LukasHedegaard / continual-transformers
Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023]
☆27Updated 11 months ago
Related projects: ⓘ
- Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention".☆43Updated 2 years ago
- VIsually-Pivoted Audio and(N) Text☆20Updated 2 years ago
- A Python library for Continual Inference Networks in PyTorch☆46Updated last year
- Pytorch implementation of Performer from the paper "Rethinking Attention with Performers".☆23Updated 3 years ago
- Implementation of Multistream Transformers in Pytorch☆54Updated 3 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 3 years ago
- Codebase for "Channel selection using Gumbel Softmax"☆18Updated 3 years ago
- Code for the C2KD paper (ICASSP 2023)☆16Updated last year
- [NeurIPS 2022] "Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Spee…☆14Updated last year
- ☆21Updated 3 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 5 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆116Updated 3 years ago
- ☆14Updated last year
- Pre-training Cross-modal Transformer for Audio-and-Language Representations☆39Updated 3 years ago
- Composing General Audio Representation by Fusing Multilayer Features of a Pre-trained Model☆26Updated last year
- Code for the paper: Audio-Visual Model Distillation Using Acoustic Images☆20Updated last year
- Reference implementation of DecDTW in PyTorch (ICLR 2023)☆19Updated last year
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆33Updated last year
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆39Updated last year
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆106Updated 3 years ago
- Code for Discriminative Sounding Objects Localization (NeurIPS 2020)☆57Updated 2 years ago
- Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch☆53Updated 3 years ago
- A variant of Transformer-XL where the memory is updated not with a queue, but with attention☆45Updated 4 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆34Updated 3 years ago
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆26Updated 2 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆49Updated 2 years ago
- Codes for paper <InteL-VAEs: Adding Inductive Biases to VariationalAuto-Encoders via Intermediary Latents>.☆18Updated 3 years ago
- Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)☆64Updated 10 months ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆55Updated last year
- custom cuda kernel for {2, 3}d relative attention with pytorch wrapper☆43Updated 4 years ago