Alternatives and similar repositories for Lip2Speech

Users that are interested in Lip2Speech are comparing it to the libraries listed below

• ms-dot-k / Visual-Context-Attentional-GAN
  PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)
  ☆25Updated last year
• KAIST-AILab / SyncVSR
  [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
  ☆56Updated 4 months ago
• ms-dot-k / Lip-to-Speech-Synthesis-in-the-Wild
  PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)
  ☆70Updated last year
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆51Updated 2 years ago
• naver-ai / facetts
  ☆57Updated 2 years ago
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆40Updated 9 months ago
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆52Updated last year
• BenoitWang / Speech_Emotion_Diarization
  ☆68Updated 10 months ago
• Dianezzy / ParaLip
  Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code
  ☆110Updated 3 years ago
• yochaiye / LipVoicer
  Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"
  ☆71Updated 10 months ago
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆108Updated last year
• CODEJIN / NaturalSpeech2
  ☆140Updated last year
• winddori2002 / TriAAN-VC
  TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion
  ☆146Updated last year
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆67Updated 5 months ago
• walkoncross / voxceleb2-download-zyf
  Tools for downloading VoxCeleb2 dataset
  ☆30Updated last year
• DanielMengLiu / AudioVisualLip
  ☆23Updated last year
• kamepong / StarGAN-VC
  ☆24Updated 3 years ago
• wonjune-kang / lvc-vc
  End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
  ☆92Updated last year
• X-E-Speech / X-E-Speech-code
  X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion
  ☆99Updated last year
• roudimit / whisper-flamingo
  Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation
  ☆176Updated last week
• zcxu-eric / AVA-AVD
  ☆45Updated 2 years ago
• biggytruck / SpeechSplit2
  Official implementation of SpeechSplit2
  ☆134Updated 2 years ago
• abikaki / awesome-speech-emotion-recognition
  😎 Awesome lists about Speech Emotion Recognition
  ☆93Updated 7 months ago
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆181Updated last year
• ConsistencyVC / ConsistencyVC-voive-conversion
  Using joint training speaker encoder with consistency loss to achieve cross-lingual voice conversion and expressive voice conversion
  ☆148Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• yanghaha0908 / EmoVoice
  Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"
  ☆59Updated 3 months ago
• YoungSeng / SRD-VC
  Speech Representation Disentanglement with Adversarial Mutual Information Learning for One-shot Voice Conversion (Interspeech 2022)
  ☆117Updated last year
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆37Updated 11 months ago
• iiscleap / ZEST
  Zero-Shot Emotion Style Transfer
  ☆49Updated 3 months ago