Alternatives and similar repositories for Visual-Audio-Memory:

Users that are interested in Visual-Audio-Memory are comparing it to the libraries listed below

• ms-dot-k / Multi-head-Visual-Audio-Memory
  PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022)
  ☆25Updated 10 months ago
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆30Updated last year
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• xing96 / MIM-lipreading
  Code and model for paper <Mutual Information Maximization for Effective Lip Reading>
  ☆20Updated 4 years ago
• jingyunx / Deformation-Flow-Based-Two-stream-Network-for-Lip-Reading
  ☆16Updated 3 years ago
• ms-dot-k / AVSR
  PyTorch implementation of "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scorin…
  ☆14Updated 9 months ago
• yunyikristy / global_local
  ☆14Updated 3 years ago
• YapengTian / CCOL-CVPR21
  Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation
  ☆25Updated 3 years ago
• Exgc / OpenSR
  The official implementation of OpenSR (ACL2023 Oral)
  ☆15Updated last year
• DTaoo / Discriminative-Sounding-Objects-Localization
  Code for Discriminative Sounding Objects Localization (NeurIPS 2020)
  ☆57Updated 3 years ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆96Updated last year
• jasongief / PSP_CVPR_2021
  [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line
  ☆41Updated 2 years ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆61Updated 6 months ago
• DanielMengLiu / DeepLip
  deep-learning based audio-visual lip bometrics
  ☆14Updated last year
• KID-7391 / seeking-the-shape-of-sound
  ☆17Updated 3 years ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆52Updated last year
• GeWu-Lab / MUSIC-AVQA
  MUSIC-AVQA, CVPR2022 (ORAL)
  ☆73Updated 2 years ago
• JackSyu / Discriminative-Multi-modality-Speech-Recognition
  TF code for our CVPR2020 paper "Discriminative Multi-modality Speech Recognition"
  ☆25Updated 2 years ago
• hche11 / Localizing-Visual-Sounds-the-Hard-Way
  Localizing Visual Sounds the Hard Way
  ☆78Updated 2 years ago
• LUMIA-Group / Leveraging-Self-Supervised-Learning-for-AVSR
  Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…
  ☆64Updated 2 years ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆52Updated 3 years ago
• weiguoPian / AV-CIL_ICCV2023
  ☆20Updated 4 months ago
• GeWu-Lab / CSOL_TPAMI2021
  The repo for "Class-aware Sounding Objects Localization", TPAMI 2021.
  ☆29Updated 2 years ago
• Cocoxili / CMPC
  [IJCAI2022] Unsupervised Voice-Face Representation Learning by Cross-Modal Prototype Contrast
  ☆20Updated last year
• akoepke / audio-retrieval-benchmark
  Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".
  ☆49Updated 2 years ago
• GeWu-Lab / MMCosine_ICASSP23
  The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"
  ☆18Updated last year
• stoneMo / AVGN
  Official implementation for AVGN
  ☆34Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆29Updated 2 years ago
• fuankarion / active-speakers-context
  Code for the Active Speakers in Context Paper (CVPR2020)
  ☆53Updated 3 years ago
• VIPL-Audio-Visual-Speech-Understanding / deep-face-speechreading
  Visual speech recognition with face inputs: code and models for F&G 2020 paper "Can We Read Speech Beyond the Lips? Rethinking RoI Select…
  ☆17Updated 3 years ago