kapoorparul / Towards-Automatic-Speech-to-SL
☆17Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for Towards-Automatic-Speech-to-SL
- A curated list of awesome work on Sign Language Production☆59Updated last year
- Facial Expression Feature Extractor☆67Updated 2 years ago
- PATS Dataset. Aligned Pose-Audio-Transcripts and Style for co-speech gesture research☆53Updated last year
- Official implementation for "Ham2Pose: Animating Sign Language Notation into Pose Sequences" [CVPR 2023]☆43Updated 4 months ago
- This repository contains scripts to build Youtube Gesture Dataset.☆118Updated last year
- Official code for the paper "Visual Speech Enhancement Without A Real Visual Stream" published at WACV 2021☆103Updated 5 months ago
- Implementation of NWT, audio-to-video generation, in Pytorch☆87Updated 2 years ago
- PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "☆40Updated 3 years ago
- An open source implementation of CLIP.☆10Updated last year
- Watch, read and lookup: learning to spot signs from multiple supervisors, ACCV 2020 (Best Application Paper)☆28Updated last year
- Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)☆14Updated last year
- Official pytorch implementation for Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion (CVPR 2022)☆108Updated 3 months ago
- This is the official implementation for IVA'20 Best Paper Award paper "Let's Face It: Probabilistic Multi-modal Interlocutor-aware Gener…☆16Updated last year
- Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity (SIGGRAPH Asia 2020)☆245Updated 2 years ago
- Official Repository for the paper Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach published …☆29Updated 4 months ago
- The official implementation for ICMI 2020 Best Paper Award "Gesticulator: A framework for semantically-aware speech-driven gesture gener…☆122Updated last year
- [CVPR 2022] Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning☆193Updated 2 years ago
- Source code for "Progressive Transformers for End-to-End Sign Language Production" (ECCV 2020)☆105Updated 10 months ago
- Unsupervised Any-to-many Audiovisual Synthesis via Exemplar Autoencoders☆120Updated 2 years ago
- [ICCV 2021] The official repo for the paper "Speech Drives Templates: Co-Speech Gesture Synthesis with Learned Templates".☆88Updated last year
- ☆8Updated last year
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆111Updated 4 years ago
- CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?☆126Updated last year
- [WACV 2020] ImaGINator: Conditional Spatio-Temporal GAN for Video Generation☆33Updated 2 years ago
- ☆35Updated 6 years ago
- An implementation of simple diffusion in PyTorch (and JAX)☆35Updated last year
- This repository provides scripts that can be used to visualize BVH files. These scripts were developed for the GENEA Challenge 2020, and …☆39Updated last year
- [AAAI 2023 (Oral)] CrissCross: Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity☆23Updated last year
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆109Updated last year
- multimodal transformer☆74Updated 2 years ago