JeongHun0716 / e-mvsr
Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
☆10Updated 3 weeks ago
Related projects: ⓘ
- ☆23Updated last month
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆40Updated 2 months ago
- ☆10Updated last year
- ☆14Updated 5 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆33Updated last week
- FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis (Accepted by ISCSLP'2024)☆21Updated 6 months ago
- Temporary anonymous version☆22Updated 6 months ago
- Official implementation of DGP-based multi-speaker speech synthesis with PyTorch☆24Updated 3 years ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆32Updated last month
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated 11 months ago
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated 9 months ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆36Updated 3 weeks ago
- ☆13Updated 2 weeks ago
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆27Updated last month
- text to speech☆10Updated 6 months ago
- A spoken version of the textual story cloze benchmark☆12Updated last year
- ☆15Updated 3 years ago
- ESLTTS dataset☆15Updated 3 months ago
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆12Updated 4 months ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆29Updated 8 months ago
- Pushing the Limits of Zero-shot End-to-End Speech Translation☆20Updated last month
- A neural speech codec based on discrete WavLM representations☆14Updated 3 weeks ago
- Vocoder-Free Non-Parallel Conversion of Whispered Speech With Masked Cycle-Consistent Generative Adversarial Networks☆17Updated last year
- ☆11Updated 2 years ago
- ☆33Updated 5 months ago
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆28Updated last year
- Unofficial implementation of ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speech☆15Updated 9 months ago
- ☆10Updated 5 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆14Updated 2 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆32Updated last year