sanjayss34 / lm-listener
Implementation for the paper "Can Language Models Learn to Listen?"
☆62Updated last year
Alternatives and similar repositories for lm-listener:
Users that are interested in lm-listener are comparing it to the libraries listed below
- [ECCV 2024] Dyadic Interaction Modeling for Social Behavior Generation☆50Updated 5 months ago
- ☆16Updated 6 months ago
- Official Implementation of the Paper: Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generation (ACMMM 2024)☆57Updated last month
- ☆40Updated 3 weeks ago
- ☆16Updated 6 months ago
- LinguaLinker: Audio-Driven Portraits Animation with Implicit Facial Control Enhancement☆72Updated 8 months ago
- UnifiedGesture: A Unified Gesture Synthesis Model for Multiple Skeletons (ACM MM 2023 Oral)☆51Updated last year
- [ICCV-2023] The official repo for the paper "LivelySpeaker: Towards Semantic-aware Co-Speech Gesture Generation".☆83Updated 10 months ago
- A novel apporach for personalized speech-driven 3D facial animation☆47Updated 11 months ago
- [AAAI 2024] stle2talker - Official PyTorch Implementation☆38Updated last year
- [INTERSPEECH'24] Official repository for "MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Datase…☆93Updated 4 months ago
- Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness (ICASSP 202…☆65Updated last year
- Data and Pytorch implementation of IEEE TMM "EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation"☆24Updated last year
- ☆36Updated last year
- [CVPR'24] DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation☆147Updated 11 months ago
- ☆157Updated 6 months ago
- KAN-based Fusion of Dual Domain for Audio-Driven Landmarks Generation of the model can help you generate an sequence of facial lanmarks f…☆27Updated last month
- [ICIAP 2023] Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation☆62Updated last year
- Official Implementation of "Laughing Matters: Introducing Laughing-Face Generation using Diffusion Models"☆17Updated last year
- ☆79Updated last month
- ☆36Updated 6 months ago
- The official repository of UniMuMo☆106Updated 2 months ago
- FaceFormer Emo: Speech-Driven 3D Facial Animation with Emotion Embedding☆25Updated last year
- ☆85Updated last year
- QPGesture: Quantization-Based and Phase-Guided Motion Matching for Natural Speech-Driven Gesture Generation (CVPR 2023 Highlight)☆86Updated last year
- [IJCV 2024] Code for ReliTalk☆125Updated last year
- Towards Variable and Coordinated Holistic Co-Speech Motion Generation, CVPR 2024☆51Updated 9 months ago
- Large Motion Model for Unified Multi-Modal Motion Generation☆266Updated 3 months ago
- Official pytorch implementation for Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion (CVPR 2022)☆114Updated 7 months ago
- Code for ICLR 2024 paper "Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment"☆97Updated last year