This is an official PyTorch implementation of "Gesture2Vec: Clustering Gestures using Representation Learning Methods for Co-speech Gesture Generation" (IROS 2022).
☆27Feb 9, 2024Updated 2 years ago
Alternatives and similar repositories for Gesture2Vec
Users that are interested in Gesture2Vec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Disentangled Implicit Content and Rhythm Learning for Diverse Co-Speech Gestures Synthesis [ACMMM 2022]☆26Jun 26, 2025Updated 11 months ago
- This is the official implementation for IVA '19 paper "Analyzing Input and Output Representations for Speech-Driven Gesture Generation".☆10Jul 12, 2022Updated 3 years ago
- The ReprGesture entry to the GENEA Challenge 2022 (IMCI 2022)☆16Nov 8, 2022Updated 3 years ago
- This is the official repository for our publication "The IVI Lab entry to the GENEA Challenge 2022 – A Tacotron2 Based Method for Co-Spee…☆13May 2, 2023Updated 3 years ago
- UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons (ACM MM 2023 Oral)☆56Jan 15, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repository contains data pre-processing and visualization scripts used in GENEA Challenge 2022 and 2023. Check the repository's READ…☆28May 29, 2025Updated last year
- Scripts for numerical evaluations for the GENEA Gesture Generation Challenge☆24Nov 28, 2022Updated 3 years ago
- Pragmatic models for generating and following instructions☆13Dec 22, 2019Updated 6 years ago
- ☆23Feb 2, 2026Updated 4 months ago
- [CVPR'2023] Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation☆263Mar 18, 2026Updated 3 months ago
- QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation (CVPR 2023 Highlight)☆105Oct 18, 2023Updated 2 years ago
- Official Implementation of AQ-GT: a Temporally Aligned and Quantized GRU-Transformer for Co-Speech Gesture Synthesis with the extension (…☆21Apr 19, 2024Updated 2 years ago
- This is the official implementation for IVA '19 paper "Analyzing Input and Output Representations for Speech-Driven Gesture Generation".☆110Jul 6, 2023Updated 2 years ago
- Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity (SIGGRAPH Asia 2020)☆275Dec 14, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is an implementation of Robots learn social skills: End-to-end learning of co-speech gesture generation for humanoid robots.☆81Dec 9, 2022Updated 3 years ago
- Code for "Audio-Driven Co-Speech Gesture Video Generation" (NeurIPS 2022, Spotlight Presentation).☆88Dec 5, 2022Updated 3 years ago
- ☆221Mar 1, 2025Updated last year
- ☆13Jun 7, 2023Updated 3 years ago
- PATS Dataset. Aligned Pose-Audio-Transcripts and Style for co-speech gesture research☆64Jul 15, 2023Updated 2 years ago
- Code for CVPR 2024 paper: ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis☆36Apr 29, 2025Updated last year
- Talking with Hands☆99Aug 20, 2021Updated 4 years ago
- ☆14Feb 9, 2023Updated 3 years ago
- Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness (ICASSP 202…☆79Apr 9, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Hi4D: 4D Instance Segmentation of Close Human Interaction (CVPR2023)☆98May 27, 2024Updated 2 years ago
- Scalable learning with pragmatics☆11Mar 31, 2018Updated 8 years ago
- [AAAI 2024] MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation☆35Mar 1, 2024Updated 2 years ago
- Speech-Driven Expression Blendshape Based on Single-Layer Self-attention Network (AIWIN 2022)☆78Oct 21, 2022Updated 3 years ago
- [ICCV-2023] The official repo for the paper "LivelySpeaker: Towards Semantic-aware Co-Speech Gesture Generation".☆87Jun 3, 2024Updated 2 years ago
- ☆19Jul 8, 2024Updated last year
- Audio2Motion Official implementation for Audio2Motion: Generating Diverse Gestures from Speech with Conditional Variational Autoencoders.☆147Jan 1, 2024Updated 2 years ago
- ☆21Dec 9, 2023Updated 2 years ago
- Data and Pytorch implementation of IEEE TMM "EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation"☆31Mar 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models (IJCAI 2023) | The DiffuseStyleGesture+ ent…☆213Apr 9, 2026Updated 2 months ago
- Motion classes, based on Holden's code http://theorangeduck.com/page/deep-learning-framework-character-motion-synthesis-and-editing☆26Apr 23, 2026Updated last month
- [AAAI 2025] Official repo for paper "MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls"☆128Jan 18, 2025Updated last year
- GDPnet: "Geometry-guided Dense Perspective Network for Speech-Driven Facial Animation." (TVCG 2021)☆11Nov 21, 2021Updated 4 years ago
- Code and data for "A fine-grained comparison of pragmatic language understanding in humans and language models"☆11Dec 14, 2022Updated 3 years ago
- Official implementation for "MOVIN: Real-time Motion Capture using a Single LiDAR"☆19Oct 24, 2024Updated last year
- Code for processing brain data☆12Apr 5, 2019Updated 7 years ago