yochaiye / LipVoicer
Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"
☆63Updated 7 months ago
Alternatives and similar repositories for LipVoicer:
Users that are interested in LipVoicer are comparing it to the libraries listed below
- ☆140Updated last year
- ZMM-TTS: Zero-shot Multilingual and Multispeaker Speech Synthesis Conditioned on Self-supervised Discrete Speech Representations☆152Updated last year
- The official implementation of EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vector (TAFFC 20…☆84Updated this week
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆33Updated 5 months ago
- FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3☆195Updated last year
- Official Pytorch Implementation for "DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for V…☆217Updated 8 months ago
- Official implementation of USR (NeurIPS 2024)☆29Updated 3 months ago
- DEX-TTS: Diffusion-based EXpressive TTS with Style Modeling on Time Variability☆101Updated 3 months ago
- Diffusion Model for Voice Conversion☆51Updated last year
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆136Updated this week
- Speech Representation Disentanglement with Adversarial Mutual Information Learning for One-shot Voice Conversion (Interspeech 2022)☆116Updated last year
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆150Updated 2 months ago
- Style-Controllable Zero-Shot Text to Speech Synthesizer based on VALL-E☆138Updated 5 months ago
- The official implementation of EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotio…☆117Updated last week
- TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion☆146Updated last year
- Training code for FAcodec presented in NaturalSpeech3☆204Updated 7 months ago
- VoiceLDM: Text-to-Speech with Environmental Context☆174Updated 8 months ago
- ☆71Updated 2 months ago
- ☆46Updated last year
- End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions☆93Updated last year
- Official Pytorch Implementation of "Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Pr…☆215Updated 9 months ago
- This repository contains the code and data for the paper EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control by Haozhe Chen,…☆69Updated 6 months ago
- ☆65Updated 7 months ago
- ☆65Updated last year
- Official Implementation of StyleTTS-VC☆177Updated 3 months ago
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆129Updated 3 months ago
- Official implementation of SpeechSplit2☆132Updated 2 years ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆87Updated last year
- Using joint training speaker encoder with consistency loss to achieve cross-lingual voice conversion and expressive voice conversion☆144Updated last year
- Implementation of DCComix TTS: An End-to-End Expressive TTS with Discrete Code Collaborated with Mixer☆74Updated last year