lucidrains / NWT-pytorch
Implementation of NWT, audio-to-video generation, in Pytorch
☆87Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for NWT-pytorch
- Toward Spatially Unbiased Generative Models (ICCV 2021)☆90Updated 3 years ago
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆104Updated 2 years ago
- [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"☆53Updated 2 years ago
- An implementation of simple diffusion in PyTorch (and JAX)☆35Updated last year
- The project page repo for Neural Dubber.☆29Updated last year
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆109Updated last year
- Code for Vision-Infused Deep Audio Inpainting (ICCV 2019)☆56Updated 5 years ago
- Unsupervised Any-to-many Audiovisual Synthesis via Exemplar Autoencoders☆120Updated 2 years ago
- Demo for 2022 ICASSP☆64Updated 2 years ago
- Audio Demo for "FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulation"☆19Updated 3 years ago
- Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code☆106Updated 2 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 3 years ago
- A convolution-free, transformer-only version of the CycleGAN framework☆32Updated 2 years ago
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆40Updated 3 years ago
- Efficient synchronization from sparse cues☆28Updated 6 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆77Updated 5 months ago
- ☆26Updated 3 years ago
- Aggregating embeddings over time☆31Updated last year
- Adversarial Training of Denoising Diffusion Model Using Dual Discriminators for High-Fidelity Multi-Speaker TTS☆35Updated last year
- AlignNet: A Unifying Approach to Audio-Visual Alignment (WACV 2020)☆31Updated 3 years ago
- Unofficial implementation of Neural Analysis and Synthesis☆7Updated 2 years ago
- Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration☆34Updated 3 years ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆37Updated last year
- ☆48Updated last year
- My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation☆82Updated last month
- Talking Face Generation by Conditional Recurrent Adversarial Network☆61Updated 4 years ago
- Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices☆61Updated 7 months ago
- Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch☆64Updated 2 years ago
- Official PyTorch implementation for FastDPM, a fast sampling algorithm for diffusion probabilistic models☆81Updated 3 years ago
- Official implementation of OSSGAN [CVPR 2022]☆22Updated 2 years ago