Alternatives and similar repositories for Lip-to-Speech-Synthesis-in-the-Wild

Users that are interested in Lip-to-Speech-Synthesis-in-the-Wild are comparing it to the libraries listed below

• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆47Updated last year
• Chris10M / Lip2Speech
  A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.
  ☆93Updated 4 months ago
• naver-ai / facetts
  ☆59Updated 2 years ago
• ms-dot-k / Visual-Context-Attentional-GAN
  PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)
  ☆25Updated last year
• winddori2002 / TriAAN-VC
  TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion
  ☆148Updated last year
• KAIST-AILab / SyncVSR
  [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
  ☆59Updated 8 months ago
• Moon0316 / T2A
  Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023
  ☆86Updated 2 years ago
• BenoitWang / Speech_Emotion_Diarization
  ☆69Updated last year
• ConsistencyVC / ConsistencyVC-voive-conversion
  Using joint training speaker encoder with consistency loss to achieve cross-lingual voice conversion and expressive voice conversion
  ☆152Updated 2 years ago
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆51Updated 3 years ago
• yl4579 / AuxiliaryASR
  Joint CTC-S2S Phoneme-level ASR for Voice Conversion and TTS (Text-Mel Alignment)
  ☆124Updated 3 years ago
• bshall / urhythmic
  Unsupervised Rhythm Modeling for Voice Conversion
  ☆84Updated 2 years ago
• X-E-Speech / X-E-Speech-code
  X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion
  ☆109Updated last year
• CODEJIN / NaturalSpeech2
  ☆140Updated last year
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆58Updated last year
• yl4579 / StyleTTS-VC
  Official Implementation of StyleTTS-VC
  ☆194Updated 10 months ago
• walkoncross / voxceleb2-download-zyf
  Tools for downloading VoxCeleb2 dataset
  ☆33Updated last year
• wonjune-kang / lvc-vc
  End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
  ☆94Updated 2 years ago
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆110Updated last year
• hayeong0 / Diff-HierVC
  Official Pytorch Implementation of "Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Pr…
  ☆231Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• thuhcsi / LightGrad
  ☆68Updated 2 years ago
• biggytruck / SpeechSplit2
  Official implementation of SpeechSplit2
  ☆133Updated 3 years ago
• Choddeok / EmoSpherepp
  [TAFFC 2025] The official implementation of EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vec…
  ☆111Updated 3 months ago
• xjchenGit / MTDVocaLiST
  Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization (ICASSP 2024).
  ☆25Updated last year
• iiscleap / ZEST
  Zero-Shot Emotion Style Transfer
  ☆49Updated 7 months ago
• KunZhou9646 / Mixed_Emotions
  ☆121Updated 3 years ago
• IS2AI / KazEmoTTS
  An open-source Kazakh Emotional Text-to-Speech Dataset
  ☆34Updated 4 months ago
• hcy71o / TransferTTS
  TransferTTS (Zero-Shot learning of VITS)
  ☆101Updated 3 years ago
• CODEJIN / HierSpeech
  ☆68Updated 2 years ago