Alternatives and similar repositories for Lip2Speech

Users that are interested in Lip2Speech are comparing it to the libraries listed below

• ms-dot-k / Visual-Context-Attentional-GAN
  PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)
  ☆23Updated last year
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆50Updated 2 years ago
• KAIST-AILab / SyncVSR
  [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
  ☆49Updated last month
• ms-dot-k / Lip-to-Speech-Synthesis-in-the-Wild
  PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)
  ☆67Updated last year
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆36Updated 6 months ago
• naver-ai / facetts
  ☆55Updated last year
• yochaiye / LipVoicer
  Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"
  ☆64Updated 7 months ago
• walkoncross / voxceleb2-download-zyf
  Tools for downloading VoxCeleb2 dataset
  ☆29Updated last year
• prajwalkr / vtp
  Official Implementation of Visual Transformer Pooling for Lip reading
  ☆40Updated 2 years ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆63Updated 2 months ago
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆52Updated last year
• KunZhou9646 / Emovox
  This is the implementation of the paper "Emotion Intensity and its Control for Emotional Voice Conversion".
  ☆89Updated 3 years ago
• BenoitWang / Speech_Emotion_Diarization
  ☆65Updated 7 months ago
• vskadandale / vocalist
  Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
  ☆66Updated last year
• Jiang-Yidi / TS-TalkNet
  INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues
  ☆51Updated last year
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆35Updated 8 months ago
• X-E-Speech / X-E-Speech-code
  X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion
  ☆89Updated last year
• YoungSeng / SRD-VC
  Speech Representation Disentanglement with Adversarial Mutual Information Learning for One-shot Voice Conversion (Interspeech 2022)
  ☆117Updated last year
• smeetrs / deep_avsr
  A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.
  ☆227Updated last year
• KunZhou9646 / seq2seq-EVC
  This is the implementation of our Interspeech 2021 paper: Limited data emotional voice conversion leveraging text-to-speech: two-stage se…
  ☆83Updated 2 years ago
• wonjune-kang / lvc-vc
  End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
  ☆92Updated last year
• 0417keito / PromptTTS2
  [WIP] Unofficial Implementation of Microsoft's PromptTTS2
  ☆51Updated last year
• DanielMengLiu / AudioVisualLip
  ☆22Updated last year
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• KunZhou9646 / Mixed_Emotions
  ☆117Updated 2 years ago
• sectum1919 / cncvs_data_collector
  ☆22Updated last year
• Moon0316 / T2A
  Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023
  ☆86Updated last year
• LUMIA-Group / Leveraging-Self-Supervised-Learning-for-AVSR
  Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…
  ☆65Updated 2 years ago
• DataoceanAI / CNVSRC2023Baseline
  Baseline system for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023)
  ☆22Updated last year
• xjchenGit / MTDVocaLiST
  Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization (ICASSP 2024).
  ☆23Updated last year