smeetrs / deep_avsr
A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.
☆209Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for deep_avsr
- Pytorch code for End-to-End Audiovisual Speech Recognition☆174Updated 2 years ago
- Auto-AVSR: Lip-Reading Sentences Project☆180Updated 7 months ago
- Code and models for evaluating a state-of-the-art lip reading network☆189Updated last year
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆150Updated last year
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆203Updated last year
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆391Updated last year
- Official implementation for the paper Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition☆144Updated 3 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆221Updated last year
- Visual Speech Recognition for Multiple Languages☆349Updated last year
- Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…☆63Updated 2 years ago
- Audio-Visual Speech Recognition using Sequence to Sequence Models☆81Updated 4 years ago
- A collection of datasets for the purpose of emotion recognition/detection in speech.☆296Updated last month
- Official implementation of INTERSPEECH 2021 paper 'Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings'☆126Updated 2 years ago
- [WACV 2023] Audio-Visual Efficient Conformer (AVEC) for Robust Speech Recognition☆92Updated last year
- ☆139Updated 4 months ago
- This is the GitHub page for publicly available emotional speech data.☆322Updated 2 years ago
- The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to Improve Multimodal Speech Emotion R…☆114Updated 3 years ago
- The state-of-art PyTorch implementation of the method described in the paper "LipNet: End-to-End Sentence-level Lipreading" (https://arxi…☆209Updated 2 years ago
- [ICASSP 2023] Official Tensorflow implementation of "Temporal Modeling Matters: A Novel Temporal Emotional Modeling Approach for Speech E…☆161Updated 6 months ago
- ☆98Updated 2 years ago
- Baseline system for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023)☆21Updated 6 months ago
- ☆137Updated last year
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆154Updated 4 years ago
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆201Updated 10 months ago
- Official repository for RawNet, RawNet2, and RawNet3☆361Updated 8 months ago
- [InterSpeech 2020] "AutoSpeech: Neural Architecture Search for Speaker Recognition" by Shaojin Ding*, Tianlong Chen*, Xinyu Gong, Weiwei …☆208Updated last year
- Multi-modal Speech Emotion Recogniton on IEMOCAP dataset☆85Updated last year
- A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.☆78Updated 2 years ago
- Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments☆106Updated 8 months ago
- Deep speaker embeddings in PyTorch, including x-vectors. Code used in this work: https://arxiv.org/abs/2007.16196☆306Updated 4 years ago