NYElegance / SimulLR

Related projects: ⓘ

• Exgc / AVMuST-TED
  ☆22Updated 5 months ago
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆99Updated 3 months ago
• LUMIA-Group / Leveraging-Self-Supervised-Learning-for-AVSR
  Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…
  ☆60Updated 2 years ago
• Zain-Jiang / Dict-TTS
  ☆131Updated last year
• wanglin-lw / ST-Caps
  ☆11Updated last year
• marmot-xy / CMBS
  cross modal background suppression for audio-visual event localization
  ☆34Updated 2 years ago
• vskadandale / vocalist
  Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
  ☆61Updated 5 months ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆30Updated last year
• the-anonymous-bs / av-SALMONN
  av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
  ☆14Updated 4 months ago
• rxtan2 / AVSeT
  ☆15Updated 11 months ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆50Updated 7 months ago
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆28Updated last year
• ubc-vision / TriBERT
  Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…
  ☆13Updated 2 years ago
• ms-dot-k / Multi-head-Visual-Audio-Memory
  PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022)
  ☆24Updated 6 months ago
• Levent9 / Zero-shot-FaceVC
  ☆14Updated 6 months ago
• YapengTian / CCOL-CVPR21
  Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation
  ☆23Updated 2 years ago
• prajwalkr / vtp
  Official Implementation of Visual Transformer Pooling for Lip reading
  ☆35Updated 2 years ago
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆99Updated 5 months ago
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆194Updated last month
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆20Updated 2 weeks ago
• zcxu-eric / AVA-AVD
  ☆43Updated last year
• sony / CLIPSep
  ☆35Updated last year
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆65Updated 5 months ago
• GeWu-Lab / MUSIC-AVQA
  MUSIC-AVQA, CVPR2022 (ORAL)
  ☆66Updated last year
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆48Updated last year
• stoneMo / EZ-VSL
  Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)
  ☆29Updated last year
• ms-dot-k / Visual-Context-Attentional-GAN
  PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)
  ☆21Updated 6 months ago
• HS-YN / PanoAVQA
  Official repository of PanoAVQA: Grounded Audio-Visual Question Answering in 360° Videos (ICCV 2021)
  ☆13Updated 2 years ago
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆21Updated last month
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆29Updated 9 months ago