ZZDoog / Speaker2Dubber
[ACM MM24] Official implementation of paper "From Speaker to Dubber: Movie Dubbing with Prosody and Duration Consistency Learning"
☆25Updated 2 weeks ago
Alternatives and similar repositories for Speaker2Dubber:
Users that are interested in Speaker2Dubber are comparing it to the libraries listed below
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆72Updated 2 months ago
- official implementation of MGA-CLAP (ACM MM 2024)☆12Updated 3 months ago
- ☆24Updated 4 months ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆61Updated 5 months ago
- [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation☆32Updated 4 months ago
- [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.☆102Updated 7 months ago
- Source code for DM-Codec.☆35Updated 3 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆19Updated last week
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆38Updated 3 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025)☆18Updated last month
- ☆22Updated 10 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆44Updated 2 weeks ago
- ☆28Updated 6 months ago
- Pytorch implementation for “V2C: Visual Voice Cloning”☆29Updated 2 years ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year
- ☆15Updated 9 months ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆41Updated 9 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆61Updated 2 months ago
- ☆11Updated last year
- Code for ICASSP 2024 Paper: RECAP: Retrieval-Augmented Audio Captioning☆11Updated 7 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆43Updated 2 months ago
- Official Implementation and Dataset of paper - DFADD: The Diffusion and Flow-matching based Audio Deepfake Dataset☆12Updated last week
- The implementation of paper "SpeechTripleNet: End-to-End Disentangled Speech Representation Learning for Content, Timbre and Prosody"☆31Updated last year
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆49Updated 3 months ago
- Source code for the paper 'Audio Captioning Transformer'☆52Updated 3 years ago
- ☆37Updated last year
- Implementation of Multi-Source Music Generation with Latent Diffusion.☆21Updated 4 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆112Updated last month
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆27Updated 2 months ago
- The official implementation of OpenSR (ACL2023 Oral)☆15Updated last year