Alternatives and similar repositories for cav2vec

Users that are interested in cav2vec are comparing it to the libraries listed below

• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆68Updated 6 months ago
• kaistmm / VoxMM
  ☆18Updated last year
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆37Updated 11 months ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆34Updated 2 years ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆56Updated last year
• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆31Updated 8 months ago
• ms-dot-k / Image-to-Speech
  Pytorch implementation of "Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal T…
  ☆12Updated last year
• umbertocappellazzo / PETL_AST
  This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…
  ☆38Updated last year
• ANLGBOY / ICLR-2024-OpenReview-Ratings
  ☆31Updated last year
• Jiang-Yidi / TS-TalkNet
  INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues
  ☆52Updated 2 years ago
• zcxu-eric / AVA-AVD
  ☆46Updated 2 years ago
• minguinho26 / Prefix_AAC_ICASSP2023
  Official Implementation of "Prefix tuning for Automated Audio Captioning(ICASSP 2023)"
  ☆30Updated last year
• ms-dot-k / AVSR
  PyTorch implementation of "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scorin…
  ☆18Updated last year
• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆120Updated last month
• Alexander-H-Liu / dinosr
  DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning
  ☆49Updated last year
• YasserdahouML / VSR_test_set
  WildVSR
  ☆17Updated last year
• choijeongsoo / utut
  [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
  ☆31Updated 11 months ago
• W-Wu / DEER
  ☆12Updated 2 years ago
• sungnyun / ARMHuBERT
  (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT
  ☆40Updated 11 months ago
• usc-sail / peft-ser
  PEFT-SER: On the Use of Parameter Efficient Transfer Learning Approaches For Speech Emotion Recognition Using Pre-trained Speech Models (…
  ☆60Updated last year
• JinhuaLiang / lam4fsl
  An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"
  ☆31Updated 2 years ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆56Updated 3 years ago
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆17Updated 5 months ago
• sony / CLIPSep
  ☆42Updated 2 years ago
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆44Updated last month
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆184Updated 2 months ago
• sungnyun / avsr-temporal-dynamics
  (SLT 2024) Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition
  ☆12Updated 10 months ago
• jaeyeonkim99 / visage
  Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)
  ☆30Updated 2 months ago
• Exgc / AVMuST-TED
  ☆23Updated last year