Alternatives and similar repositories for cav-mae-sync

Users that are interested in cav-mae-sync are comparing it to the libraries listed below

• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆30Updated 5 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆83Updated 11 months ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆65Updated 3 months ago
• BriansIDP / AudioVisualLLM
  ☆18Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆55Updated 2 years ago
• schowdhury671 / meerkat
  ☆29Updated 7 months ago
• roudimit / c2kd
  Code for the C2KD paper (ICASSP 2023)
  ☆18Updated 2 years ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆52Updated last year
• rxtan2 / AVSeT
  ☆16Updated last year
• LoieSun / Auto-ACD
  code for A Large-scale Dataset for Audio-Language Representation Learning
  ☆13Updated 8 months ago
• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆78Updated 11 months ago
• kaistmm / SSLalignment
  ☆32Updated last week
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆64Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• stoneMo / AVGN
  Official implementation for AVGN
  ☆34Updated 2 years ago
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆16Updated 2 months ago
• stoneMo / MGN
  Official implementation for MGN
  ☆20Updated 2 years ago
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆98Updated 7 months ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆53Updated 3 years ago
• Ego4DSounds / Ego4DSounds
  Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence
  ☆18Updated 11 months ago
• JeongHun0716 / MMS-LLaMA
  Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…
  ☆28Updated this week
• kaistmm / VoxMM
  ☆16Updated last year
• qiuk2 / AAR
  [Official Implementation] Acoustic Autoregressive Modeling 🔥
  ☆69Updated 9 months ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆21Updated 8 months ago
• W-Wu / DEER
  ☆11Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆62Updated 4 months ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆51Updated last year
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆33Updated last year
• guyyariv / vLMIG
  This repo contains the official PyTorch implementation of vLMIG: Improving Visual Commonsense in Language Models via Multiple Image Gener…
  ☆16Updated 11 months ago
• GeWu-Lab / MWAFM
  Multi-Scale Attention for Audio Question Answering
  ☆28Updated last year