YUCHEN005 / UniVPMLinks
Code for paper "Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition"
☆28Updated 2 years ago
Alternatives and similar repositories for UniVPM
Users that are interested in UniVPM are comparing it to the libraries listed below
Sorting:
- ☆38Updated 9 months ago
- ☆24Updated last year
- ☆59Updated 2 years ago
- ☆48Updated 3 years ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆25Updated last year
- Official release of StyleTalk dataset.☆72Updated last year
- ☆70Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆78Updated last year
- ☆23Updated 4 years ago
- ☆62Updated 6 months ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆60Updated 10 months ago
- ☆15Updated last year
- YOLO-Stutter: End-to-end Region-Wise Speech Dysfluency Detection☆20Updated 10 months ago
- Speaker-aware CTC (SACTC) for multi-talker overlapped speech recognition.☆21Updated 8 months ago
- ☆30Updated 7 months ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆111Updated last year
- Official Code for ParrotTTS☆58Updated last year
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Updated 2 years ago
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆25Updated last year
- [InterSpeech'2023] "Betray Oneself: A Novel Audio DeepFake Detection Model via Mono-to-Stereo Conversion"☆13Updated last year
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆77Updated 11 months ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆49Updated last year
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆59Updated last year
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆96Updated last year
- Official PyTorch implementation for "Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech …☆32Updated 8 months ago
- ViSpeR: Multilingual Audio-Visual Speech Recognition☆55Updated 9 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆56Updated last year
- Zero-Shot Emotion Style Transfer☆49Updated 9 months ago
- INTERSPEECH 2023: "DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models"☆116Updated 2 years ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆47Updated last year