facebookresearch / seamless_interactionLinks
Foundation Models and Data for Human-Human and Human-AI interactions.
☆312Updated 3 months ago
Alternatives and similar repositories for seamless_interaction
Users that are interested in seamless_interaction are comparing it to the libraries listed below
Sorting:
- [CVPR'24] DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation☆190Updated last year
- Official pytorch implementation for Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion (CVPR 2022)☆123Updated last year
- [CVPR 2024] AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion☆132Updated last year
- [ECCV 2024] Dyadic Interaction Modeling for Social Behavior Generation☆62Updated 7 months ago
- Official Implementation of the Paper: Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation (ACMMM 2024)☆72Updated 5 months ago
- ICCV 2025☆58Updated 2 months ago
- UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons (ACM MM 2023 Oral)☆54Updated last year
- Data and Pytorch implementation of IEEE TMM "EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation"☆29Updated last year
- ☆116Updated 9 months ago
- This repository contains scripts to build Youtube Gesture Dataset.☆129Updated 2 years ago
- PATS Dataset. Aligned Pose-Audio-Transcripts and Style for co-speech gesture research☆62Updated 2 years ago
- [CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"☆143Updated 2 years ago
- [ICCV-2023] The official repo for the paper "LivelySpeaker: Towards Semantic-aware Co-Speech Gesture Generation".☆86Updated last year
- ARTalk generates realistic 3D head motions (lip sync, blinking, expressions, head poses) from audio in ⚡ real-time ⚡.☆100Updated 5 months ago
- Towards Variable and Coordinated Holistic Co-Speech Motion Generation, CVPR 2024☆58Updated last year
- This repository contains the official implementation of "The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Moti…☆60Updated last month
- ☆217Updated 8 months ago
- [AAAI2025] Official repo for paper "MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls"☆113Updated 10 months ago
- ☆51Updated 4 months ago
- ☆44Updated 4 months ago
- Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness (ICASSP 202…☆71Updated last year
- DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models (IJCAI 2023) | The DiffuseStyleGesture+ ent…☆198Updated 2 years ago
- ☆95Updated 3 months ago
- Scripts for numerical evaluations for the GENEA Gesture Generation Challenge☆24Updated 2 years ago
- Official code release of "DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animation" [AAAI2025]☆55Updated 9 months ago
- QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation (CVPR 2023 Highlight)☆101Updated 2 years ago
- [CVPR 2024] POPDG: Popular 3D Dance Generation with PopDanceSet☆57Updated 5 months ago
- Official code for the paper "Understanding Co-speech Gestures in-the-wild"☆19Updated 3 weeks ago
- Implementation for the paper "Can Language Models Learn to Listen?"☆68Updated 2 years ago
- Code for CVPR 2024 paper: ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis☆35Updated 6 months ago