rash1993 / movie-asdLinks
repo for active speaker detection for media videos.
☆29Updated last year
Alternatives and similar repositories for movie-asd
Users that are interested in movie-asd are comparing it to the libraries listed below
Sorting:
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆156Updated 7 months ago
- Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)☆67Updated 2 years ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆59Updated 7 months ago
- code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection☆41Updated 2 years ago
- ☆58Updated 4 months ago
- Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation☆191Updated 3 months ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆55Updated last year
- Anim-400K: A dataset designed from the ground up for automated dubbing of video☆109Updated last year
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆46Updated last year
- ☆19Updated 2 years ago
- A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.☆93Updated 3 months ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- ☆19Updated 10 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆86Updated last year
- ☆66Updated 3 years ago
- Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language☆84Updated last year
- Look Who’s Talking: Active Speaker Detection in the Wild☆74Updated 2 years ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆47Updated last year
- ☆20Updated 3 years ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated 9 months ago
- Graph learning framework for long-term video understanding☆67Updated 3 months ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆116Updated 2 years ago
- The repository for Springer IJCV 2025 (LR-ASD: Lightweight and Robust Network for Active Speaker Detection)☆64Updated 7 months ago
- Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.☆68Updated last week
- ☆62Updated last year
- INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues☆54Updated 2 years ago
- A 28× Compressed Wav2Lip for Efficient Talking Face Generation [ICCV'23 Demo] [MLSys'23 Workshop] [NVIDIA GTC'23]☆58Updated last year
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆55Updated 2 years ago
- This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptati…☆128Updated 8 months ago
- ☆47Updated 2 years ago