mpc001 / auto_avsr
Auto-AVSR: Lip-Reading Sentences Project
☆315Updated last month
Alternatives and similar repositories for auto_avsr:
Users that are interested in auto_avsr are comparing it to the libraries listed below
- Visual Speech Recognition for Multiple Languages☆388Updated last year
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆219Updated last year
- A pipeline to read lips and generate speech for the read content, i.e Lip to Speech Synthesis.☆78Updated 3 years ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆140Updated 2 weeks ago
- Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"☆59Updated 5 months ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆47Updated 2 months ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆407Updated last year
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆206Updated 8 months ago
- Implementation of Spear-TTS - multi-speaker text-to-speech attention network, in Pytorch☆267Updated last year
- This is the audio sample repository for speech separation model "MossFormer2".☆120Updated 3 months ago
- Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation☆369Updated this week
- MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation☆380Updated last year
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆351Updated last year
- Official Implementation of StyleTTS☆422Updated last month
- A fully working pytorch implementation of NaturalSpeech (Tan et al., 2022)☆474Updated last year
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆27Updated 4 months ago
- Update ASR paper everyday☆143Updated this week
- VoiceLDM: Text-to-Speech with Environmental Context☆170Updated 6 months ago
- 🔊 Create labeled datasets, enhance audio quality, identify speakers, support diverse dataset types. 🎧👥📊 Advanced audio processing.☆234Updated 8 months ago
- A curated list of awesome voice conversion, projects and communities.☆223Updated last month
- The Open Source Code of UniAudio☆545Updated 7 months ago
- [CVPR] MARLIN: Masked Autoencoder for facial video Representation LearnINg☆244Updated 2 months ago
- Official Implementation of Visual Transformer Pooling for Lip reading☆40Updated 2 years ago
- Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three differen…☆221Updated 2 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆227Updated last year
- ☆253Updated 11 months ago
- [ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training fo…☆748Updated 2 months ago
- Automatically Update Text-to-speech (TTS) Papers Daily using Github Actions (Update Every 12th hours)☆374Updated this week
- A self-supervised learning framework for audio-visual speech☆879Updated last year