facebookresearch / VisualVoice
Audio-Visual Speech Separation with Cross-Modal Consistency
☆229Updated last year
Alternatives and similar repositories for VisualVoice:
Users that are interested in VisualVoice are comparing it to the libraries listed below
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆207Updated 2 years ago
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆159Updated 5 years ago
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆125Updated last month
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆227Updated last year
- Audio-Visual Speech Recognition using Sequence to Sequence Models☆82Updated 4 years ago
- Research code for the paper "Fine-tuning wav2vec2 for speaker recognition" found at https://arxiv.org/abs/2109.15053☆144Updated 2 years ago
- Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments☆107Updated last year
- Implementation of "Duration Informed Attention Network for Multimodal Synthesis" paper in PyTorch.☆183Updated 4 years ago
- PPG-Based Voice Conversion☆335Updated 2 years ago
- Code for the Active Speakers in Context Paper (CVPR2020)☆54Updated 3 years ago
- An open source dataset for source separation☆416Updated last year
- This is the GitHub page for publicly available emotional speech data.☆345Updated 3 years ago
- Include some core functions and model to handle speech separation☆155Updated 3 years ago
- Speaker embedding (d-vector) trained with GE2E loss☆281Updated last year
- ICASSP 2022: 'Self-supervised Speaker Recognition with Loss-gated Learning'☆89Updated last year
- The official PyTorch implementation of "FullSubNet+: Channel Attention FullSubNet with Complex Spectrograms for Speech Enhancement".☆256Updated last year
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆370Updated last year
- UniSpeech - Large Scale Self-Supervised Learning for Speech☆456Updated last year
- Official repository for RawNet, RawNet2, and RawNet3☆376Updated last year
- Official Implementation of Visual Transformer Pooling for Lip reading☆40Updated 2 years ago
- ☆149Updated 2 years ago
- [InterSpeech 2020] "AutoSpeech: Neural Architecture Search for Speaker Recognition" by Shaojin Ding*, Tianlong Chen*, Xinyu Gong, Weiwei …☆208Updated 2 years ago
- Speech Separation☆62Updated last year
- mirror of VoxCeleb dataset - a large-scale speaker identification dataset☆71Updated 5 years ago
- Augmentation adversarial training for self-supervised speaker recognition☆77Updated 3 years ago
- Co-Separating Sounds of Visual Objects (ICCV 2019)☆94Updated last year
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆159Updated last year
- Official code for the paper "Visual Speech Enhancement Without A Real Visual Stream" published at WACV 2021☆106Updated 10 months ago
- Deep speaker embeddings in PyTorch, including x-vectors. Code used in this work: https://arxiv.org/abs/2007.16196☆314Updated 4 years ago
- transform-average-concatenate (TAC) method for end-to-end microphone permutation and number invariant ad-hoc beamforming.☆271Updated 3 years ago