TaoRuijie / TalkNet-ASD
ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'
☆312Updated last year
Related projects ⓘ
Alternatives and complementary repositories for TalkNet-ASD
- Audio-Visual Speech Separation with Cross-Modal Consistency☆220Updated last year
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆101Updated 7 months ago
- Auto-AVSR: Lip-Reading Sentences Project☆173Updated 6 months ago
- Out of time: automated lip sync in the wild☆671Updated 9 months ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆391Updated last year
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆207Updated 8 months ago
- Visual Speech Recognition for Multiple Languages☆340Updated last year
- Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)☆366Updated 2 years ago
- Audio-Visual Active Speaker Detection with PyTorch on AVA-ActiveSpeaker dataset☆57Updated 2 years ago
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆154Updated 4 years ago
- Code for the Active Speakers in Context Paper (CVPR2020)☆53Updated 3 years ago
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆149Updated last year
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆203Updated last year
- Code and models for evaluating a state-of-the-art lip reading network☆189Updated last year
- Official Implementation of Visual Transformer Pooling for Lip reading☆36Updated 2 years ago
- Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three differen…☆204Updated 2 years ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆111Updated 3 years ago
- Audio-Visual Speech Recognition using Sequence to Sequence Models☆82Updated 4 years ago
- A collection of datasets for the purpose of emotion recognition/detection in speech.☆290Updated last month
- MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face Generation [ECCV2020]☆244Updated 4 months ago
- ☆138Updated 4 months ago
- A self-supervised learning framework for audio-visual speech☆847Updated 11 months ago
- ☆45Updated last year
- This is the GitHub page for publicly available emotional speech data.☆320Updated 2 years ago
- INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues☆46Updated last year
- The state-of-art PyTorch implementation of the method described in the paper "LipNet: End-to-End Sentence-level Lipreading" (https://arxi…☆209Updated 2 years ago
- Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)☆64Updated last year
- Official code for the paper "Visual Speech Enhancement Without A Real Visual Stream" published at WACV 2021☆103Updated 5 months ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆41Updated 9 months ago
- A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.☆76Updated 2 years ago