code for training the models from the paper "Learning Individual Styles of Conversational Gestures"
☆394Mar 6, 2024Updated last year
Alternatives and similar repositories for speech2gesture
Users that are interested in speech2gesture are comparing it to the libraries listed below
Sorting:
- Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity (SIGGRAPH Asia 2020)☆273Dec 14, 2021Updated 4 years ago
- Freeform Body Motion Generation from Speech☆210Nov 12, 2022Updated 3 years ago
- [CVPR'2023] Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation☆260Sep 5, 2023Updated 2 years ago
- [CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"☆144Mar 16, 2023Updated 2 years ago
- ☆487Aug 8, 2023Updated 2 years ago
- [ICCV 2021] The official repo for the paper "Speech Drives Templates: Co-Speech Gesture Synthesis with Learned Templates".☆97Jun 3, 2023Updated 2 years ago
- This is the official implementation for IVA '19 paper "Analyzing Input and Output Representations for Speech-Driven Gesture Generation".☆110Jul 6, 2023Updated 2 years ago
- This repository contains scripts to build Youtube Gesture Dataset.☆131Nov 9, 2023Updated 2 years ago
- The official implementation for ICMI 2020 Best Paper Award "Gesticulator: A framework for semantically-aware speech-driven gesture gener…☆128Feb 16, 2023Updated 3 years ago
- This is an implementation of Robots learn social skills: End-to-end learning of co-speech gesture generation for humanoid robots.☆79Dec 9, 2022Updated 3 years ago
- Audio2Motion Official implementation for Audio2Motion: Generating Diverse Gestures from Speech with Conditional Variational Autoencoders.☆144Jan 1, 2024Updated 2 years ago
- Code for SEEG: Semantic Energized Co-speech Gesture Generation☆33Dec 3, 2022Updated 3 years ago
- This is the official implementation of the paper "Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Vir…☆31Nov 16, 2021Updated 4 years ago
- Language2Pose: Natural Language Grounded Pose Forecasting☆68Sep 18, 2020Updated 5 years ago
- This is the official implementation of the paper "Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial A…☆51Feb 28, 2023Updated 3 years ago
- Talking with Hands☆94Aug 20, 2021Updated 4 years ago
- This is the official repository for TalkSHOW: Generating Holistic 3D Human Motion from Speech [CVPR2023].☆367Nov 1, 2023Updated 2 years ago
- This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character me…☆1,253Aug 20, 2024Updated last year
- PATS Dataset. Aligned Pose-Audio-Transcripts and Style for co-speech gesture research☆64Jul 15, 2023Updated 2 years ago
- ☆208Mar 10, 2021Updated 4 years ago
- DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models (IJCAI 2023) | The DiffuseStyleGesture+ ent…☆205Nov 20, 2025Updated 3 months ago
- Code for "Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose" (Arxiv 2020) and "Predicting Personalize…☆774Dec 15, 2023Updated 2 years ago
- ☆219Mar 1, 2025Updated last year
- [CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers☆905Aug 22, 2023Updated 2 years ago
- the dataset and code for "Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset"☆422May 12, 2024Updated last year
- This repository contains a PyTorch implementation of "AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis".☆1,068Oct 27, 2023Updated 2 years ago
- SGToolkit: An Interactive Gesture Authoring Toolkit for Embodied Conversational Agents (UIST 2021)☆45Sep 14, 2022Updated 3 years ago
- QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation (CVPR 2023 Highlight)☆102Oct 18, 2023Updated 2 years ago
- Code for "Audio-Driven Co-Speech Gesture Video Generation" (NeurIPS 2022, Spotlight Presentation).☆87Dec 5, 2022Updated 3 years ago
- PantoMatrix: Generating Face and Body Animation from Speech☆1,190Jan 16, 2025Updated last year
- The ReprGesture entry to the GENEA Challenge 2022 (IMCI 2022)☆16Nov 8, 2022Updated 3 years ago
- Code for paper 'Audio-Driven Emotional Video Portraits'.☆314Mar 16, 2022Updated 3 years ago
- This repository contains data pre-processing and visualization scripts used in GENEA Challenge 2022 and 2023. Check the repository's READ…☆27May 29, 2025Updated 9 months ago
- A method to estimate 3D hand gestures from 3D body motion input in body languages.☆109Apr 25, 2022Updated 3 years ago
- MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face Generation [ECCV2020]☆292Jul 7, 2024Updated last year
- This is the codebase for SHOW in Generating Holistic 3D Human Motion from Speech [CVPR2023],☆239Sep 8, 2024Updated last year
- Code for ACCV 2020 "Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses"☆100Apr 8, 2021Updated 4 years ago
- Audio To Body Dynamics, CVPR 2018☆119Oct 30, 2018Updated 7 years ago
- GFGE☆15Sep 7, 2022Updated 3 years ago