vskadandale / vocalist
Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
☆61Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for vocalist
- Talking Head from Speech Audio using a Pre-trained Image Generator☆23Updated 6 months ago
- Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization (ICASSP 2024).☆23Updated 7 months ago
- Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023☆83Updated last year
- ☆19Updated last year
- The MAVD represents Mandarin Audio-Visual dataset with Depth information. MAVD has a rich variety of modal data, including audio, RGB ima…☆16Updated 6 months ago
- ☆86Updated last year
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆154Updated 4 years ago
- the dataset and code for "Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset"☆94Updated 6 months ago
- This is official inference code of PD-FGC☆81Updated last year
- Code for paper 'EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model'☆186Updated last year
- A novel apporach for personalized speech-driven 3D facial animation☆44Updated 6 months ago
- ☆72Updated last year
- MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face Generation [ECCV2020]☆246Updated 4 months ago
- Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code☆106Updated 2 years ago
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆22Updated 8 months ago
- Tools for downloading VoxCeleb2 dataset☆26Updated 8 months ago
- ☆96Updated 9 months ago
- PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)☆65Updated 8 months ago
- [CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"☆129Updated last year
- This dataset is presented in the paper Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video…☆12Updated 2 years ago
- Project of "Adaptive Affine Transformation: A Simple and Effective Operation for Spatial Misaligned Image Generation"☆57Updated last year
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆51Updated 9 months ago
- [ICCV2023] Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video☆64Updated 7 months ago
- The project page repo for Neural Dubber.☆29Updated last year
- SyncTalkFace: Talking Face Generation for Precise Lip-syncing via Audio-Lip Memory☆33Updated 2 years ago
- Official github repo for paper "What comprises a good talking-head video generation?: A Survey and Benchmark"☆90Updated last year
- Authors official PyTorch implementation of the "HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Faces" [IC…☆79Updated last year
- a PyTorch implementation of Lip2Wav☆49Updated 2 years ago
- An improved version of APB2Face: Real-Time Audio-Guided Multi-Face Reenactment☆82Updated 3 years ago