Alternatives and similar repositories for cav-mae-sync

Users that are interested in cav-mae-sync are comparing it to the libraries listed below

• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆84Updated last year
• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆31Updated 7 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆85Updated last year
• naver-ai / rewas
  Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"
  ☆42Updated 7 months ago
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆100Updated 9 months ago
• BriansIDP / AudioVisualLLM
  ☆18Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆55Updated 2 years ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆67Updated 5 months ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆22Updated 10 months ago
• schowdhury671 / meerkat
  ☆31Updated last month
• kaistmm / SSLalignment
  ☆34Updated 2 months ago
• sangho-vision / acav100m
  ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
  ☆59Updated 3 years ago
• JongSuk1 / EquiAV
  ☆33Updated 6 months ago
• roudimit / c2kd
  Code for the C2KD paper (ICASSP 2023)
  ☆18Updated 2 years ago
• stoneMo / MGN
  Official implementation for MGN
  ☆20Updated 2 years ago
• stoneMo / AVGN
  Official implementation for AVGN
  ☆35Updated 2 years ago
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆267Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆79Updated 6 months ago
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆37Updated 2 years ago
• kaistmm / VoxMM
  ☆17Updated last year
• facebookresearch / MAViL
  The repo host the code and model of MAViL.
  ☆44Updated 2 years ago
• pritamqu / CrissCross
  [AAAI 2023 (Oral)] CrissCross: Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity
  ☆25Updated 2 years ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆56Updated 3 years ago
• epic-kitchens / epic-sounds-annotations
  Splits for epic-sounds dataset
  ☆79Updated last week
• rxtan2 / AVSeT
  ☆17Updated last year
• LoieSun / Auto-ACD
  code for A Large-scale Dataset for Audio-Language Representation Learning
  ☆14Updated 10 months ago
• JeongHun0716 / MMS-LLaMA
  Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…
  ☆33Updated last month
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆17Updated 4 months ago
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆34Updated 2 years ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆102Updated 2 years ago