MetaGenAI / multimodal-transflower
multimodal probabilistic autoregressive models
☆17Updated last year
Related projects ⓘ
Alternatives and complementary repositories for multimodal-transflower
- multimodal transformer☆74Updated 2 years ago
- The personal repository of the work: *DanceNet3D: Music Based Dance Generation with Parametric Motion Transformer*.☆53Updated 3 years ago
- Implementation of NWT, audio-to-video generation, in Pytorch☆87Updated 2 years ago
- [ECCV2022] D2M-GAN for music generation from dance videos☆85Updated 2 years ago
- Audio-driven synthesis of choreographic movements using GANs☆18Updated 5 years ago
- Talking with Hands☆86Updated 3 years ago
- ☆57Updated 5 years ago
- Crystal TTVS engine is a real-time audio-visual Multilingual speech synthesizer with a 3D expressive avatar.☆84Updated 4 years ago
- Parallel and High-Fidelity Text-to-Lip Generation; AAAI 2022 ; Official code☆106Updated 2 years ago
- This is the official implementation of the paper "Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial A…☆44Updated last year
- This is an official PyTorch implementation of "Gesture2Vec: Clustering Gestures using Representation Learning Methods for Co-speech Gestu…☆25Updated 9 months ago
- Dataset build for music to dance motion synthesis.☆40Updated 5 years ago
- The project page repo for Neural Dubber.☆27Updated last year
- Official PyTorch implementation of the paper "A Brand New Dance Partner:Music-Conditioned Pluralistic Dancing Synthesized by Multiple Dan…☆34Updated 2 years ago
- Demo for 2022 Interspeech☆29Updated 2 years ago
- Unsupervised Any-to-many Audiovisual Synthesis via Exemplar Autoencoders☆120Updated last year
- Sequential Learning for Dance generation☆21Updated 3 years ago
- ☆17Updated 3 years ago
- ☆11Updated 2 years ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆37Updated last year
- This is the official implementation of the paper "Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Vir…☆27Updated 2 years ago
- Code repo of the paper "DeepDance: Music-to-Dance Motion Choreography with Adversarial Learning"☆54Updated 3 years ago
- Code for "SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces" ACM MM 2023☆30Updated last year
- This is an implementation of Robots learn social skills: End-to-end learning of co-speech gesture generation for humanoid robots.☆72Updated last year
- This is the official implementation for IVA'20 Best Paper Award paper "Let's Face It: Probabilistic Multi-modal Interlocutor-aware Gener…☆16Updated last year
- PATS Dataset. Aligned Pose-Audio-Transcripts and Style for co-speech gesture research☆53Updated last year
- ☆95Updated 8 months ago
- This is the official implementation for IVA '19 paper "Analyzing Input and Output Representations for Speech-Driven Gesture Generation".☆107Updated last year
- Official repo of Text-Free Learning of a Natural Language Interface for Pretrained Face Generators☆66Updated 10 months ago
- Official pytorch implementation for Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion (CVPR 2022)☆108Updated 2 months ago