lucidrains / NWT-pytorch
Implementation of NWT, audio-to-video generation, in Pytorch
☆88Updated 2 years ago
Alternatives and similar repositories for NWT-pytorch:
Users that are interested in NWT-pytorch are comparing it to the libraries listed below
- Toward Spatially Unbiased Generative Models (ICCV 2021)☆90Updated 3 years ago
- [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"☆54Updated 2 years ago
- Code for Vision-Infused Deep Audio Inpainting (ICCV 2019)☆56Updated 5 years ago
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆106Updated 2 years ago
- An implementation of simple diffusion in PyTorch (and JAX)☆35Updated 2 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 3 years ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆112Updated 2 years ago
- Talking Head from Speech Audio using a Pre-trained Image Generator☆23Updated 10 months ago
- Unsupervised Any-to-many Audiovisual Synthesis via Exemplar Autoencoders☆120Updated 2 years ago
- The project page repo for Neural Dubber.☆29Updated last year
- ☆16Updated 3 years ago
- Audio Demo for "FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulation"☆20Updated 3 years ago
- Pytorch implementation of sparse_image_warp and an example of GoogleBrain's SpecAugment is given: A Simple Data Augmentation Method for A…☆23Updated 5 years ago
- Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code☆108Updated 2 years ago
- Demo for 2022 ICASSP☆64Updated 2 years ago
- Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration☆34Updated 3 years ago
- Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices☆63Updated 11 months ago
- This repository contains the implementation and audio sampels of Conditional Spoken Digit Generation with StyleGAN paper.☆20Updated 7 months ago
- Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)☆64Updated 3 years ago
- Demo audio of VARA-TTS model☆20Updated 3 years ago
- Official PyTorch implementation for FastDPM, a fast sampling algorithm for diffusion probabilistic models☆82Updated 3 years ago
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆59Updated 4 years ago
- Pytorch implementation of "A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences", Pranay Manocha et al. - un…☆61Updated 4 years ago
- AlignNet: A Unifying Approach to Audio-Visual Alignment (WACV 2020)☆32Updated 4 years ago
- a pytorch implementation of Google GEDLoss☆32Updated 4 years ago
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆39Updated 4 years ago
- My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation☆83Updated 5 months ago
- Official repo of Text-Free Learning of a Natural Language Interface for Pretrained Face Generators☆66Updated last year
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆39Updated last year
- An improved version of APB2Face: Real-Time Audio-Guided Multi-Face Reenactment☆82Updated 3 years ago