YUCHEN005 / UniVPMLinks
Code for paper "Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition"
☆24Updated 2 years ago
Alternatives and similar repositories for UniVPM
Users that are interested in UniVPM are comparing it to the libraries listed below
Sorting:
- ☆23Updated last year
- Analysis of XLS-R for Speech Quality Assessment☆13Updated 5 months ago
- PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)☆25Updated last year
- ☆56Updated 2 years ago
- ICSD Dataset☆29Updated last month
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆73Updated 8 months ago
- Official release of StyleTalk dataset.☆67Updated last year
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year
- ☆10Updated 3 years ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆24Updated last year
- Code for paper "Unsupervised Noise adaptation using Data Simulation"☆13Updated last year
- This is the implementation our Interspeech 2022 paper " Disentanglement of Emotional Style and Speaker Identity for Expressive Voice Conv…☆20Updated last year
- ViSpeR: Multilingual Audio-Visual Speech Recognition☆41Updated 2 months ago
- Zero-Shot Emotion Style Transfer☆48Updated 2 months ago
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆55Updated last year
- ☆35Updated 3 months ago
- Streaming Audiotransformers for online Audio tagging☆45Updated last year
- ☆24Updated 2 months ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆55Updated 3 months ago
- ☆45Updated 2 years ago
- ☆13Updated last year
- Official PyTorch inference code for the Interspeech 2025 paper: Efficient Speech Enhancement via Embeddings from Pre-trained Generative A…☆45Updated 3 weeks ago
- repository for paper "Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysis"☆17Updated 3 years ago
- Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))☆45Updated 11 months ago
- ☆66Updated 10 months ago
- ☆26Updated 8 months ago
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆55Updated 8 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆40Updated 8 months ago
- [WIP] Unofficial Implementation of Microsoft's PromptTTS2☆51Updated last year
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆39Updated last year