mpc001 / auto_avsr
Auto-AVSR: Lip-Reading Sentences Project
☆195Updated 3 weeks ago
Alternatives and similar repositories for auto_avsr:
Users that are interested in auto_avsr are comparing it to the libraries listed below
- Visual Speech Recognition for Multiple Languages☆371Updated last year
- Official Implementation of Visual Transformer Pooling for Lip reading☆39Updated 2 years ago
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆219Updated 11 months ago
- ☆149Updated 6 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆61Updated 6 months ago
- [WACV 2023] Audio-Visual Efficient Conformer (AVEC) for Robust Speech Recognition☆92Updated last year
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆39Updated last month
- This is the GitHub page for publicly available emotional speech data.☆331Updated 3 years ago
- A curated list of awesome voice conversion, projects and communities.☆217Updated 2 weeks ago
- The repository for IEEE CVPR 2023 (A Light Weight Model for Active Speaker Detection)☆114Updated 10 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆27Updated 3 months ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆226Updated last year
- A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.☆79Updated 3 years ago
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆22Updated 10 months ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆105Updated last week
- a PyTorch implementation of Lip2Wav☆49Updated 2 years ago
- Official implementation for the paper Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition☆143Updated 3 years ago
- [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.☆47Updated last year
- Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three differen…☆217Updated 2 years ago
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆384Updated last year
- Disentangled Speech Embeddings using Cross-Modal Self-Supervision☆156Updated 4 years ago
- Baseline system for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023)☆21Updated 9 months ago
- Unofficial implementation of NaturalSpeech2 for Voice Conversion and Text to Speech☆234Updated 11 months ago
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆327Updated 4 months ago
- ☆140Updated last year
- PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)☆65Updated 10 months ago
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆155Updated last year
- Official Pytorch Implementation of "Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Pr…☆210Updated 6 months ago
- PPG-Based Voice Conversion☆332Updated 2 years ago
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆190Updated 7 months ago