joonson / syncnet_trainer
Disentangled Speech Embeddings using Cross-Modal Self-Supervision
☆154Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for syncnet_trainer
- Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices☆61Updated 7 months ago
- AVSpeech downloader☆66Updated 5 years ago
- Tools for downloading VoxCeleb2 dataset☆26Updated 8 months ago
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆149Updated last year
- Generating Talking Face Landmarks from Speech☆156Updated last year
- Code for the Active Speakers in Context Paper (CVPR2020)☆53Updated 3 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆221Updated last year
- MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face Generation [ECCV2020]☆246Updated 4 months ago
- a PyTorch implementation of Lip2Wav☆49Updated 2 years ago
- ☆19Updated last year
- Simple python script for downloading AVSpeech Dataset☆41Updated 8 months ago
- Implementation of "Duration Informed Attention Network for Multimodal Synthesis" paper in PyTorch.☆182Updated 4 years ago
- Official Implementation of Visual Transformer Pooling for Lip reading☆36Updated 2 years ago
- This dataset is presented in the paper Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video…☆12Updated 2 years ago
- Official code for the paper "Visual Speech Enhancement Without A Real Visual Stream" published at WACV 2021☆103Updated 5 months ago
- Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code☆106Updated 2 years ago
- processing and extracting of face and mouth image files out of the TCDTIMIT database☆44Updated 4 years ago
- Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments☆106Updated 8 months ago
- ☆35Updated 6 years ago
- mirror of VoxCeleb dataset - a large-scale speaker identification dataset☆68Updated 5 years ago
- the dataset and code for "Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset"☆94Updated 6 months ago
- Python implementation of the paper " Dynamic Temporal Alignment of Speech to Lips"☆30Updated 5 years ago
- Official github repo for paper "What comprises a good talking-head video generation?: A Survey and Benchmark"☆90Updated last year
- Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023☆83Updated last year
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆22Updated 8 months ago
- Out of time: automated lip sync in the wild☆679Updated 9 months ago
- Thanks auspicious3000's greate work! https://github.com/auspicious3000/autovc This is the implementation of generating mel-spectrogram fr…☆12Updated 5 years ago
- Talking Head from Speech Audio using a Pre-trained Image Generator☆23Updated 6 months ago
- Code for paper 'Audio-Driven Emotional Video Portraits'.☆300Updated 2 years ago
- Official implementation of SpeechSplit2☆128Updated 2 years ago