YUCHEN005 / UniVPM
Code for paper "Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition"
☆23Updated last year
Alternatives and similar repositories for UniVPM:
Users that are interested in UniVPM are comparing it to the libraries listed below
- Official release of StyleTalk dataset.☆62Updated 10 months ago
- ☆22Updated last year
- YOLO-Stutter: End-to-end Region-Wise Speech Dysfluency Detection☆17Updated 2 months ago
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆56Updated 10 months ago
- ☆55Updated last year
- ☆65Updated 7 months ago
- Zero-Shot Emotion Style Transfer☆45Updated 2 weeks ago
- X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion☆89Updated last year
- ☆13Updated last year
- Code for paper "Unsupervised Noise adaptation using Data Simulation"☆12Updated 11 months ago
- [Findings of NAACL 2024] Source code of paper CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers a…☆65Updated last year
- This is the implementation our Interspeech 2022 paper " Disentanglement of Emotional Style and Speaker Identity for Expressive Voice Conv…☆19Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆68Updated 6 months ago
- Code and data repository for paper "VoxCeleb enrichment for Age and Gender recognition" submitted at ASRU 2021☆67Updated 3 years ago
- Streaming Audiotransformers for online Audio tagging☆44Updated 10 months ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆36Updated 6 months ago
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆40Updated last month
- Analysis of XLS-R for Speech Quality Assessment☆13Updated 3 months ago
- [WIP] Unofficial Implementation of Microsoft's PromptTTS2☆51Updated last year
- ☆30Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆58Updated 6 months ago
- ☆46Updated 2 years ago
- The Official Implementation of “Content-Dependent Fine-Grained Speaker Embedding for Zero-Shot Speaker Adaptation in Text-to-Speech Synth…☆85Updated 2 years ago
- Official code for Interspeech 2023 paper "Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clusterin…☆52Updated last year
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆139Updated this week
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆175Updated 9 months ago
- ☆73Updated 3 months ago
- ☆14Updated 7 months ago
- ☆16Updated 5 months ago
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆28Updated 2 months ago