rash1993 / movie-asd
repo for active speaker detection for media videos.
☆22Updated last year
Alternatives and similar repositories for movie-asd:
Users that are interested in movie-asd are comparing it to the libraries listed below
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆113Updated 9 months ago
- Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection (ECCV 2022)☆65Updated last year
- This is the official repository for our ECCV 2022 paper titled, "The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assis…☆48Updated 2 years ago
- code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection☆23Updated last year
- SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization (Interspeech 2024)☆38Updated last month
- ☆15Updated 2 years ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆45Updated 11 months ago
- ☆52Updated 6 months ago
- Official code for the paper "GestSync: Determining who is speaking without a talking head" published at BMVC 2023☆36Updated 4 months ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆102Updated this week
- Anim-400K: A dataset designed from the ground up for automated dubbing of video☆102Updated 6 months ago
- [ICASSP 2024] DiffDub: Person-generic visual dubbing using inpainting renderer with diffusion auto-encoder☆54Updated 5 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated 2 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆79Updated 7 months ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆29Updated last year
- PyTorch implementation of NEUTART, a system that creates photorealistic talking avatars from an input text transcription.☆33Updated 10 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆106Updated 3 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆27Updated 2 months ago
- ☆40Updated last month
- Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language☆68Updated 7 months ago
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆168Updated 9 months ago
- INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues☆47Updated last year
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆111Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆52Updated 11 months ago
- Official Implementation of EnCLAP (ICASSP 2024)☆90Updated 7 months ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆39Updated 8 months ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- The demo page of UniAudio☆34Updated 11 months ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆80Updated last year