facebookresearch / VisualVoice
Audio-Visual Speech Separation with Cross-Modal Consistency
☆225Updated last year
Alternatives and similar repositories for VisualVoice:
Users that are interested in VisualVoice are comparing it to the libraries listed below
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆205Updated last year
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆218Updated 11 months ago
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆156Updated 4 years ago
- Auto-AVSR: Lip-Reading Sentences Project☆193Updated last week
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆154Updated last year
- PPG-Based Voice Conversion☆330Updated 2 years ago
- Speaker embedding (d-vector) trained with GE2E loss☆273Updated last year
- The official PyTorch implementation of "FullSubNet+: Channel Attention FullSubNet with Complex Spectrograms for Speech Enhancement".☆249Updated 8 months ago
- Code for the Active Speakers in Context Paper (CVPR2020)☆53Updated 3 years ago
- VGGSound: A Large-scale Audio-Visual Dataset☆301Updated 3 years ago
- Research code for the paper "Fine-tuning wav2vec2 for speaker recognition" found at https://arxiv.org/abs/2109.15053☆144Updated 2 years ago
- An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…☆397Updated last year
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆112Updated 9 months ago
- This is the GitHub page for publicly available emotional speech data.☆330Updated 3 years ago
- Implementation of "Duration Informed Attention Network for Multimodal Synthesis" paper in PyTorch.☆183Updated 4 years ago
- Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments☆106Updated 9 months ago
- ☆144Updated 2 years ago
- Official repository for RawNet, RawNet2, and RawNet3☆367Updated 9 months ago
- Audio-Visual Speech Recognition using Sequence to Sequence Models☆82Updated 4 years ago
- Include some core functions and model to handle speech separation☆155Updated 3 years ago
- This repository includes the code to reproduce our paper "End-to-End Spectro-Temporal Graph Attention Networks for Speaker Verification A…☆83Updated last year
- Official implementation of VQMIVC: One-shot (any-to-any) Voice Conversion @ Interspeech 2021 + Online playing demo!☆342Updated 2 years ago
- A PyTorch implementation of "TasNet: Surpassing Ideal Time-Frequency Masking for Speech Separation" (see recipes in aps framework https:/…☆209Updated last year
- The Easy Communications (EasyCom) dataset is a world-first dataset designed to help mitigate the *cocktail party effect* from an augmente…☆107Updated last year
- Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…☆64Updated 2 years ago
- An open source dataset for source separation☆391Updated 11 months ago
- Explicit Estimation of Magnitude and Phase Spectra in Parallel for High-Quality Speech Enhancement☆348Updated 2 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆60Updated 6 months ago
- Official Implementation of Visual Transformer Pooling for Lip reading☆38Updated 2 years ago
- transform-average-concatenate (TAC) method for end-to-end microphone permutation and number invariant ad-hoc beamforming.☆266Updated 3 years ago