facebookresearch / av_hubert
A self-supervised learning framework for audio-visual speech
☆832Updated 9 months ago
Related projects: ⓘ
- Visual Speech Recognition for Multiple Languages☆322Updated last year
- Auto-AVSR: Lip-Reading Sentences Project☆164Updated 5 months ago
- In defence of metric learning for speaker recognition☆1,027Updated 5 months ago
- MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation☆353Updated last year
- Out of time: automated lip sync in the wild☆644Updated 7 months ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆218Updated last year
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆202Updated 7 months ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆380Updated last year
- A fully working pytorch implementation of NaturalSpeech (Tan et al., 2022)☆464Updated 7 months ago
- [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…☆578Updated last week
- Large, modern dataset for speech recognition☆629Updated 6 months ago
- This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.☆555Updated last year
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆296Updated 10 months ago
- FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversion☆589Updated 5 months ago
- Awesome speech/audio LLMs, representation learning, and codec models☆580Updated last week
- The Open Source Code of UniAudio☆509Updated last month
- Research and Production Oriented Speaker Verification, Recognition and Diarization Toolkit☆672Updated this week
- Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".☆1,115Updated last year
- YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyone☆878Updated last year
- UniSpeech - Large Scale Self-Supervised Learning for Speech☆419Updated 5 months ago
- INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. …☆630Updated last month
- Library for Textless Spoken Language Processing☆521Updated last year
- Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.☆673Updated 10 months ago
- An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…☆375Updated last year
- Keep track of big models in audio domain, including speech, singing, music etc.☆431Updated 8 months ago
- Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch☆593Updated 7 months ago
- A large-scale multilingual speech corpus for representation learning, semi-supervised learning and interpretation☆508Updated last year
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆363Updated 4 months ago
- Official PyTorch implementation of BigVGAN (ICLR 2023)☆841Updated 2 weeks ago
- List of speech synthesis papers.☆990Updated last year