Alternatives and similar repositories for cav-mae-sync

Users that are interested in cav-mae-sync are comparing it to the libraries listed below

• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆85Updated last year
• kaistmm / SSLalignment
  ☆35Updated 6 months ago
• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆39Updated 11 months ago
• schowdhury671 / meerkat
  ☆34Updated 5 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆87Updated last year
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆38Updated last year
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆282Updated last year
• BriansIDP / AudioVisualLLM
  ☆19Updated last year
• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆57Updated last year
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆106Updated 2 years ago
• LoieSun / Auto-ACD
  code for A Large-scale Dataset for Audio-Language Representation Learning
  ☆14Updated last year
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆68Updated 2 years ago
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆101Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆57Updated 2 years ago
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆50Updated last year
• naver-ai / rewas
  Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"
  ☆44Updated last year
• stoneMo / MGN
  Official implementation for MGN
  ☆20Updated 2 years ago
• rxtan2 / AVSeT
  ☆17Updated 2 years ago
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆41Updated 3 years ago
• roudimit / c2kd
  Code for the C2KD paper (ICASSP 2023)
  ☆18Updated 2 years ago
• JeongHun0716 / zero-avsr
  Official PyTorch implementation for "Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech …
  ☆30Updated 7 months ago
• Ego4DSounds / Ego4DSounds
  Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence
  ☆18Updated last year
• kaistmm / Audio-Mamba-AuM
  Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"
  ☆164Updated last year
• vvvb-github / AVSegFormer
  [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer
  ☆72Updated 9 months ago
• weiguoPian / AV-CIL_ICCV2023
  ☆32Updated last year
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆25Updated last year
• SAGNIKMJR / ego-AV-spatial-correspondence
  [CVPR 2024] Code and datasets for 'Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos'
  ☆12Updated last year
• JeongHun0716 / vsr-low
  Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)
  ☆15Updated 9 months ago
• facebookresearch / MAViL
  The repo host the code and model of MAViL.
  ☆44Updated 2 years ago
• epic-kitchens / epic-sounds-annotations
  Splits for epic-sounds dataset
  ☆84Updated 4 months ago