Alternatives and similar repositories for cav-mae-sync

Users that are interested in cav-mae-sync are comparing it to the libraries listed below

• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆83Updated last year
• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆31Updated 8 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆85Updated last year
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆68Updated 6 months ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆23Updated 11 months ago
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆269Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆55Updated 2 years ago
• facebookresearch / MAViL
  The repo host the code and model of MAViL.
  ☆44Updated 2 years ago
• schowdhury671 / meerkat
  ☆32Updated last month
• JeongHun0716 / zero-avsr
  Official PyTorch implementation for "Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech …
  ☆29Updated 3 months ago
• sangho-vision / acav100m
  ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
  ☆62Updated 3 years ago
• rxtan2 / AVSeT
  ☆17Updated last year
• BriansIDP / AudioVisualLLM
  ☆19Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆86Updated 6 months ago
• LoieSun / Auto-ACD
  code for A Large-scale Dataset for Audio-Language Representation Learning
  ☆14Updated 11 months ago
• kaistmm / SSLalignment
  ☆34Updated 3 months ago
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆245Updated last year
• kaistmm / Audio-Mamba-AuM
  Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"
  ☆148Updated 9 months ago
• Ego4DSounds / Ego4DSounds
  Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence
  ☆18Updated last year
• SJTUwxz / LoCoNet_ASD
  code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection
  ☆40Updated 2 years ago
• kaistmm / VoxMM
  ☆18Updated last year
• stoneMo / AVGN
  Official implementation for AVGN
  ☆36Updated 2 years ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆56Updated last year
• naver-ai / rewas
  Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"
  ☆42Updated 8 months ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆33Updated last year
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆100Updated 9 months ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆51Updated last year
• EGO4D / audio-visual
  ☆66Updated 2 years ago
• roudimit / c2kd
  Code for the C2KD paper (ICASSP 2023)
  ☆18Updated 2 years ago
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆65Updated last year