Alternatives and similar repositories for Lip-to-Speech-Synthesis-in-the-Wild

Users that are interested in Lip-to-Speech-Synthesis-in-the-Wild are comparing it to the libraries listed below

• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆40Updated 8 months ago
• ms-dot-k / Visual-Context-Attentional-GAN
  PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)
  ☆25Updated last year
• naver-ai / facetts
  ☆56Updated 2 years ago
• KAIST-AILab / SyncVSR
  [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
  ☆55Updated 3 months ago
• Chris10M / Lip2Speech
  A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.
  ☆86Updated 3 years ago
• Moon0316 / T2A
  Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023
  ☆86Updated last year
• xjchenGit / MTDVocaLiST
  Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization (ICASSP 2024).
  ☆25Updated last year
• winddori2002 / TriAAN-VC
  TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion
  ☆146Updated last year
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆51Updated 2 years ago
• BenoitWang / Speech_Emotion_Diarization
  ☆66Updated 10 months ago
• walker-hyf / ECSS
  Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)
  ☆55Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• X-E-Speech / X-E-Speech-code
  X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion
  ☆93Updated last year
• zcxu-eric / AVA-AVD
  ☆45Updated 2 years ago
• bshall / urhythmic
  Unsupervised Rhythm Modeling for Voice Conversion
  ☆83Updated last year
• iiscleap / ZEST
  Zero-Shot Emotion Style Transfer
  ☆48Updated 2 months ago
• CODEJIN / HierSpeech
  ☆67Updated 2 years ago
• vskadandale / vocalist
  Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
  ☆67Updated last year
• yl4579 / AuxiliaryASR
  Joint CTC-S2S Phoneme-level ASR for Voice Conversion and TTS (Text-Mel Alignment)
  ☆121Updated 3 years ago
• yl4579 / StyleTTS-VC
  Official Implementation of StyleTTS-VC
  ☆186Updated 6 months ago
• Labmem-Zhouyx / CDFSE_FastSpeech2
  The Official Implementation of “Content-Dependent Fine-Grained Speaker Embedding for Zero-Shot Speaker Adaptation in Text-to-Speech Synth…
  ☆86Updated 2 years ago
• Dianezzy / ParaLip
  Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code
  ☆110Updated 3 years ago
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆106Updated last year
• wonjune-kang / lvc-vc
  End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
  ☆92Updated last year
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆52Updated last year
• 0417keito / PromptTTS2
  [WIP] Unofficial Implementation of Microsoft's PromptTTS2
  ☆51Updated last year
• GalaxyCong / StyleDubber
  [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"
  ☆88Updated 8 months ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated last year
• suhitaghosh10 / emo-stargan
  Implementation of Emo-StarGAN
  ☆45Updated last year
• IS2AI / KazEmoTTS
  An open-source Kazakh Emotional Text-to-Speech Dataset
  ☆30Updated last year