facebookresearch / av_hubertLinks
A self-supervised learning framework for audio-visual speech
☆961Updated 2 years ago
Alternatives and similar repositories for av_hubert
Users that are interested in av_hubert are comparing it to the libraries listed below
Sorting:
- Visual Speech Recognition for Multiple Languages☆458Updated 2 years ago
- In defence of metric learning for speaker recognition☆1,152Updated last year
- MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation☆401Updated 2 years ago
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆431Updated 2 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆243Updated 2 years ago
- Out of time: automated lip sync in the wild☆849Updated last year
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆428Updated 2 years ago
- This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.☆595Updated 2 years ago
- Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)☆485Updated 8 months ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆635Updated last year
- A fully working pytorch implementation of NaturalSpeech (Tan et al., 2022)☆474Updated last year
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆237Updated last year
- ☆1,455Updated last year
- [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…☆1,023Updated 11 months ago
- List of speech synthesis papers.☆1,059Updated 2 years ago
- UniSpeech - Large Scale Self-Supervised Learning for Speech☆473Updated last year
- Research and Production Oriented Speaker Verification, Recognition and Diarization Toolkit☆1,111Updated last week
- Unsupervised Speech Decomposition Via Triple Information Bottleneck☆696Updated last year
- Official PyTorch implementation of BigVGAN (ICLR 2023)☆1,156Updated last year
- Learning audio concepts from natural language supervision☆621Updated last year
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆855Updated 4 years ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆463Updated last year
- Auto-AVSR: Lip-Reading Sentences Project☆393Updated 11 months ago
- An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…☆413Updated 2 years ago
- Library for Textless Spoken Language Processing☆554Updated 2 years ago
- Large, modern dataset for speech recognition☆709Updated last year
- YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyone☆1,038Updated last year
- This is the GitHub page for publicly available emotional speech data.☆377Updated 3 years ago
- Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three differen…☆254Updated 3 years ago
- INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. …☆683Updated 11 months ago