Code for CVPR 2024 paper: ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis
☆35Apr 29, 2025Updated 10 months ago
Alternatives and similar repositories for convofusion
Users that are interested in convofusion are comparing it to the libraries listed below
Sorting:
- ☆22Feb 2, 2026Updated last month
- ICCV 2025☆61Sep 10, 2025Updated 6 months ago
- ☆12Mar 30, 2022Updated 3 years ago
- Towards Variable and Coordinated Holistic Co-Speech Motion Generation, CVPR 2024☆59Jun 27, 2024Updated last year
- Data and Pytorch implementation of IEEE TMM "EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation"☆30Mar 21, 2024Updated last year
- UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons (ACM MM 2023 Oral)☆54Jan 15, 2024Updated 2 years ago
- Awesome Gesture Generation☆242Nov 8, 2025Updated 4 months ago
- [🔥ACM MM2025] EchoMask: Speech-Queried Attention-based Mask Modeling for Holistic Co-Speech Motion Generation☆23Dec 30, 2025Updated 2 months ago
- [ICCV-2023] The official repo for the paper "LivelySpeaker: Towards Semantic-aware Co-Speech Gesture Generation".☆87Jun 3, 2024Updated last year
- ☆122Feb 7, 2025Updated last year
- [CVPR'24] DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation☆195Apr 30, 2024Updated last year
- [CVPR 2024] AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion☆136Aug 28, 2024Updated last year
- DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models (IJCAI 2023) | The DiffuseStyleGesture+ ent…☆205Nov 20, 2025Updated 3 months ago
- Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness (ICASSP 202…☆74Feb 20, 2024Updated 2 years ago
- [AAAI 2025] Official repo for paper "MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls"☆125Jan 18, 2025Updated last year
- Official code for the paper "Understanding Co-speech Gestures in-the-wild"☆20Oct 31, 2025Updated 4 months ago
- Official Implementation of AQ-GT: a Temporally Aligned and Quantized GRU-Transformer for Co-Speech Gesture Synthesis with the extension (…☆21Apr 19, 2024Updated last year
- [CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"☆144Mar 16, 2023Updated 2 years ago
- ☆58Aug 8, 2023Updated 2 years ago
- This repository contains data pre-processing and visualization scripts used in GENEA Challenge 2022 and 2023. Check the repository's READ…☆27May 29, 2025Updated 9 months ago
- ☆37Jan 30, 2026Updated last month
- KMM: Key Frame Mask Mamba for Extended Motion Generation☆19Sep 22, 2025Updated 5 months ago
- QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation (CVPR 2023 Highlight)☆102Oct 18, 2023Updated 2 years ago
- This is the official repo of CVPR 2024 paper "Multimodal Sense-Informed Prediction of 3D Human Motions"☆25May 31, 2024Updated last year
- ☆17Jul 16, 2025Updated 7 months ago
- [ICME 2025] DiffusionTalker: Efficient and Compact Speech-Driven 3D Talking Head via Personalizer-Guided Distillation☆24Mar 25, 2025Updated 11 months ago
- Code for "Audio-Driven Co-Speech Gesture Video Generation" (NeurIPS 2022, Spotlight Presentation).☆87Dec 5, 2022Updated 3 years ago
- ☆21Apr 17, 2024Updated last year
- ☆133Jul 8, 2024Updated last year
- CoMA: Compositional Human Motion Generation with Multi-modal Agents☆14Jul 31, 2025Updated 7 months ago
- [AAAI 2023 Summer Symposium, Best Paper Award] Taming Diffusion Models for Music-driven Conducting Motion Generation☆26May 9, 2024Updated last year
- ☆48Jun 26, 2025Updated 8 months ago
- Code for the paper "Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with Adapters"☆24Jan 7, 2025Updated last year
- Official Implement MCM: Multi-condition Motion Synthesis Framework☆20Nov 26, 2024Updated last year
- This is an official PyTorch implementation of "Gesture2Vec: Clustering Gestures using Representation Learning Methods for Co-speech Gestu…☆26Feb 9, 2024Updated 2 years ago
- Official Implementation of the Paper: Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation (ACMMM 2024)☆76May 29, 2025Updated 9 months ago
- Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity (SIGGRAPH Asia 2020)☆273Dec 14, 2021Updated 4 years ago
- Scripts for numerical evaluations for the GENEA Gesture Generation Challenge☆24Nov 28, 2022Updated 3 years ago
- Code to reproduce the results for our SIGGRAPH 2023 paper "Listen Denoise Action"☆182Sep 20, 2023Updated 2 years ago