arxyzan / data2vec-pytorchLinks
PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI
☆184Updated 2 years ago
Alternatives and similar repositories for data2vec-pytorch
Users that are interested in data2vec-pytorch are comparing it to the libraries listed below
Sorting:
- ☆73Updated 4 years ago
- Implementation of the convolutional module from the Conformer paper, for use in Transformers☆430Updated 2 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆260Updated 4 years ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆91Updated 3 years ago
- A simple cross attention that updates both the source and target in one step☆189Updated 4 months ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆116Updated 3 years ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆207Updated 2 years ago
- Implementation of Linformer for Pytorch☆302Updated last year
- [NeurIPS'22] Squeezeformer: An Efficient Transformer for Automatic Speech Recognition☆263Updated 2 years ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆223Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated 2 years ago
- An implementation of local windowed attention for language modeling☆488Updated 4 months ago
- A minimal pytorch package implementing a gradient reversal layer.☆158Updated last year
- Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning☆166Updated last year
- Sequence modeling with Mega.☆301Updated 2 years ago
- ☆164Updated 2 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆228Updated 3 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆120Updated 4 years ago
- PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)☆148Updated 3 years ago
- [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.☆137Updated last year
- Unofficial PyTorch Implementation for pNLP-Mixer: an Efficient all-MLP Architecture for Language (https://arxiv.org/abs/2202.04350)☆65Updated 3 years ago
- The repo host the code and model of MAViL.☆44Updated 2 years ago
- Official code for Wav2Seq☆97Updated 3 years ago
- COLA contrastive pre-training method implemented in PyTorch☆43Updated 4 years ago
- SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition☆90Updated 5 years ago
- An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.☆365Updated 4 years ago
- Implementation of Fast Transformer in Pytorch☆177Updated 4 years ago
- Gradient Reversal Layer for Domain Adaptation☆130Updated 2 years ago
- Implementation of the paper "wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations" in Pytorch.☆54Updated 2 years ago
- Unofficial PyTorch implementation of Google's FNet: Mixing Tokens with Fourier Transforms. With checkpoints.☆77Updated 3 years ago