arxyzan / data2vec-pytorchLinks
PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
☆182Updated 2 years ago
Alternatives and similar repositories for data2vec-pytorch
Users that are interested in data2vec-pytorch are comparing it to the libraries listed below
Sorting:
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆115Updated 2 years ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆140Updated last year
- [NeurIPS'22] Squeezeformer: An Efficient Transformer for Automatic Speech Recognition☆258Updated 2 years ago
- Official code for Wav2Seq☆95Updated 3 years ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆216Updated 2 years ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆90Updated 2 years ago
- Implementation of the convolutional module from the Conformer paper, for use in Transformers☆417Updated 2 years ago
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆143Updated 2 years ago
- Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations☆92Updated last year
- A minimal pytorch package implementing a gradient reversal layer.☆158Updated 9 months ago
- An implementation of local windowed attention for language modeling☆470Updated 3 weeks ago
- ☆73Updated 4 years ago
- ☆163Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- A curated list of awesome adversarial reprogramming and input prompting methods for neural networks since 2022☆36Updated last year
- Unofficial PyTorch Implementation for pNLP-Mixer: an Efficient all-MLP Architecture for Language (https://arxiv.org/abs/2202.04350)☆63Updated 3 years ago
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆178Updated 5 months ago
- Sequence modeling with Mega.☆297Updated 2 years ago
- Pytorch implementation of stochastically quantized variational autoencoder (SQ-VAE)☆190Updated 3 years ago
- Python code for handling the Clotho dataset.☆81Updated 4 years ago
- [ASRU 2021] Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition☆216Updated 2 years ago
- A simple cross attention that updates both the source and target in one step☆172Updated last week
- COLA contrastive pre-training method implemented in PyTorch☆43Updated 4 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆55Updated 2 years ago
- Implementation of the paper "wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations" in Pytorch.☆49Updated 2 years ago
- CUDA-accelerated PyTorch implementation of t-SNE☆25Updated 4 years ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆204Updated last year
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆13Updated 2 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆42Updated 7 months ago