yochaiye / LipVoicer
Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"
☆59Updated 5 months ago
Alternatives and similar repositories for LipVoicer:
Users that are interested in LipVoicer are comparing it to the libraries listed below
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆125Updated 2 months ago
- DEX-TTS: Diffusion-based EXpressive TTS with Style Modeling on Time Variability☆99Updated last month
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆27Updated 4 months ago
- Diffusion Model for Voice Conversion☆47Updated 11 months ago
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆53Updated 8 months ago
- The official implementation of EmoSphere-TTS☆107Updated last month
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆51Updated 4 months ago
- Official implementation of USR (NeurIPS 2024)☆29Updated 2 months ago
- ☆69Updated last month
- ☆63Updated 5 months ago
- Official Repository For VoxBlink2☆62Updated 6 months ago
- ☆64Updated last year
- ☆46Updated last year
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆144Updated 11 months ago
- This is the implementation our Interspeech 2022 paper " Disentanglement of Emotional Style and Speaker Identity for Expressive Voice Conv…☆18Updated last year
- The official implementation of EmoSphere++☆73Updated last month
- ☆46Updated 2 years ago
- Official Pytorch Implementation for "DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for V…☆210Updated 7 months ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆51Updated 10 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆168Updated 7 months ago
- An unofficial PyTorch implementation of VALL-E☆87Updated this week
- ☆26Updated 9 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆62Updated this week
- End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions☆90Updated last year
- Speech Representation Disentanglement with Adversarial Mutual Information Learning for One-shot Voice Conversion (Interspeech 2022)☆114Updated last year
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆47Updated 2 months ago
- Zero-Shot Emotion Style Transfer☆41Updated 10 months ago
- TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion☆145Updated last year
- Official Implement of Multi-Stage Multi-Codebook (MSMC) TTS☆162Updated 10 months ago
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆22Updated 11 months ago