rash1993 / movie-asdLinks
repo for active speaker detection for media videos.
☆28Updated last year
Alternatives and similar repositories for movie-asd
Users that are interested in movie-asd are comparing it to the libraries listed below
Sorting:
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆147Updated 4 months ago
- Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)☆65Updated last year
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆56Updated 4 months ago
- code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection☆37Updated 2 years ago
- ☆54Updated last month
- Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation☆176Updated 2 weeks ago
- ☆18Updated 2 years ago
- Graph learning framework for long-term video understanding☆65Updated last month
- Anim-400K: A dataset designed from the ground up for automated dubbing of video☆108Updated last year
- The repository for Springer IJCV 2025 (LR-ASD: Lightweight and Robust Network for Active Speaker Detection)☆51Updated 4 months ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆52Updated last year
- ☆19Updated 7 months ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆115Updated 2 years ago
- ☆20Updated 3 years ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆45Updated last year
- ☆66Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆51Updated last year
- The project page repo for Neural Dubber.☆30Updated last year
- [ICASSP 2024] DiffDub: Person-generic visual dubbing using inpainting renderer with diffusion auto-encoder☆64Updated last year
- A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.☆88Updated 3 weeks ago
- ☆57Updated last year
- Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language☆84Updated last year
- Look Who’s Talking: Active Speaker Detection in the Wild☆72Updated last year
- Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.☆66Updated 2 weeks ago
- Google's SoundStorm: Efficient Parallel Audio Generation☆132Updated 2 years ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆41Updated 9 months ago
- This is the official repository for our ECCV 2022 paper titled, "The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assis…☆53Updated 2 years ago
- This repository contains the codebase for MovieCLIP: Visual Scene Recognition in Movies☆41Updated last year
- Speaker change detection using SincNet and an LSTM/Transformer☆53Updated 2 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆85Updated last year