facebookresearch / av_hubertLinks
A self-supervised learning framework for audio-visual speech
☆969Updated 2 years ago
Alternatives and similar repositories for av_hubert
Users that are interested in av_hubert are comparing it to the libraries listed below
Sorting:
- Visual Speech Recognition for Multiple Languages☆458Updated 2 years ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆431Updated 2 years ago
- MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation☆401Updated 2 years ago
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆240Updated last year
- In defence of metric learning for speaker recognition☆1,161Updated last year
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆444Updated 2 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆246Updated 2 years ago
- Out of time: automated lip sync in the wild☆870Updated 2 years ago
- Auto-AVSR: Lip-Reading Sentences Project☆402Updated last year
- A fully working pytorch implementation of NaturalSpeech (Tan et al., 2022)☆473Updated 2 years ago
- Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)☆497Updated 10 months ago
- This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.☆600Updated 2 years ago
- UniSpeech - Large Scale Self-Supervised Learning for Speech☆478Updated last year
- This is the GitHub page for publicly available emotional speech data.☆380Updated 4 years ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆645Updated last year
- ☆1,457Updated 2 years ago
- Unsupervised Speech Decomposition Via Triple Information Bottleneck☆698Updated last year
- [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…☆1,054Updated last year
- Implementation of Meta-Voicebox : The first generative AI model for speech to generalize across tasks with state-of-the-art performance.☆588Updated 2 years ago
- Library for Textless Spoken Language Processing☆555Updated 2 years ago
- Code and models for evaluating a state-of-the-art lip reading network☆197Updated 2 years ago
- Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three differen…☆257Updated 3 years ago
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆861Updated 4 years ago
- The Open Source Code of UniAudio☆598Updated last year
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆644Updated last year
- List of speech synthesis papers.☆1,063Updated 2 years ago
- Official Implementation of Visual Transformer Pooling for Lip reading☆40Updated 3 years ago
- Official PyTorch implementation of BigVGAN (ICLR 2023)☆1,182Updated last year
- INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. …☆687Updated last year
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆469Updated last year