Alternatives and similar repositories for data2vec-pytorch

Users that are interested in data2vec-pytorch are comparing it to the libraries listed below

• janfreyberg / pytorch-revgrad
  A minimal pytorch package implementing a gradient reversal layer.
  ☆158Updated 8 months ago
• lucidrains / zorro-pytorch
  Implementation of Zorro, Masked Multimodal Transformer, in Pytorch
  ☆97Updated last year
• nttcslab / byol-a
  BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation
  ☆214Updated 2 years ago
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆115Updated 2 years ago
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆176Updated 4 months ago
• lucidrains / conformer
  Implementation of the convolutional module from the Conformer paper, for use in Transformers
  ☆404Updated 2 years ago
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆460Updated 6 months ago
• kssteven418 / Squeezeformer
  [NeurIPS'22] Squeezeformer: An Efficient Transformer for Automatic Speech Recognition
  ☆254Updated 2 years ago
• alex-matton / causal-transformer-decoder
  ☆73Updated 4 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆259Updated 4 years ago
• facebookresearch / MAViL
  The repo host the code and model of MAViL.
  ☆44Updated last year
• georgian-io / Knowledge-Distillation-Toolkit
  [DEPRECATED] A knowledge distillation toolkit based on PyTorch and PyTorch Lightning.
  ☆139Updated last year
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆290Updated last year
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆296Updated 2 years ago
• huckiyang / awesome-neural-reprogramming-prompting
  A curated list of awesome adversarial reprogramming and input prompting methods for neural networks since 2022
  ☆36Updated last year
• lucidrains / bidirectional-cross-attention
  A simple cross attention that updates both the source and target in one step
  ☆172Updated last year
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• upskyy / Squeezeformer
  PyTorch implementation of "Squeezeformer: An Efficient Transformer for Automatic Speech Recognition" (NeurIPS 2022)
  ☆142Updated 2 years ago
• ctlllll / SGConv
  ☆163Updated 2 years ago
• maum-ai / pnlp-mixer
  Unofficial PyTorch Implementation for pNLP-Mixer: an Efficient all-MLP Architecture for Language (https://arxiv.org/abs/2202.04350)
  ☆63Updated 3 years ago
• YuanGongND / ssast
  Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".
  ☆388Updated 2 years ago
• facebookresearch / AudioMAE
  This repo hosts the code and models of "Masked Autoencoders that Listen".
  ☆601Updated last year
• sooftware / pytorch-lr-scheduler
  PyTorch implementation of some learning rate schedulers for deep learning researcher.
  ☆90Updated 2 years ago
• asappresearch / wav2seq
  Official code for Wav2Seq
  ☆95Updated 2 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆204Updated last year
• nttcslab / msm-mae
  Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representations
  ☆91Updated last year
• audio-captioning / clotho-dataset
  Python code for handling the Clotho dataset.
  ☆82Updated 4 years ago
• tadeephuy / GradientReversal
  Gradient Reversal Layer for Domain Adaptation
  ☆121Updated 2 years ago
• guocheng2025 / Transformer-Encoder
  Implementation of Transformer encoder in PyTorch
  ☆66Updated 4 years ago
• pyyush / SpecAugment
  SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
  ☆83Updated 4 years ago