Alternatives and similar repositories for cav-mae-sync

Users that are interested in cav-mae-sync are comparing it to the libraries listed below

• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆86Updated last year
• schowdhury671 / meerkat
  ☆37Updated 6 months ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆106Updated 2 years ago
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆52Updated last year
• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆39Updated last year
• TengdaHan / AutoAD
  [CVPR'23 Highlight] AutoAD: Movie Description in Context.
  ☆102Updated last year
• JeongHun0716 / vsr-low
  Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)
  ☆16Updated 10 months ago
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆42Updated 3 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆88Updated last year
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆57Updated 2 years ago
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆68Updated 2 years ago
• kaistmm / SSLalignment
  ☆36Updated 8 months ago
• epic-kitchens / epic-sounds-annotations
  Splits for epic-sounds dataset
  ☆84Updated 5 months ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆25Updated last year
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆78Updated 11 months ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆54Updated 2 years ago
• roudimit / c2kd
  Code for the C2KD paper (ICASSP 2023)
  ☆18Updated 2 years ago
• stoneMo / MGN
  Official implementation for MGN
  ☆20Updated 3 years ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆39Updated last year
• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆58Updated last year
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆286Updated last year
• rxtan2 / AVSeT
  ☆17Updated 2 years ago
• stoneMo / AVGN
  Official implementation for AVGN
  ☆40Updated 2 years ago
• weiguoPian / AV-CIL_ICCV2023
  ☆33Updated last year
• stoneMo / OneAVM
  Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)
  ☆12Updated 2 years ago
• GeWu-Lab / LFAV
  Towards Long Form Audio-visual Video Understanding
  ☆14Updated 2 weeks ago
• facebookresearch / MAViL
  The repo host the code and model of MAViL.
  ☆45Updated 2 years ago
• BriansIDP / AudioVisualLLM
  ☆19Updated last year
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆20Updated 10 months ago
• stoneMo / EZ-VSL
  Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)
  ☆38Updated 3 years ago