ms-dot-k / TMT
TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages
☆14Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for TMT
- Aty-TTS: Improving fairness for spoken language understanding in atypical speech with Text-to-Speech☆10Updated 11 months ago
- A toolkit dedicate for speech evaluation.☆18Updated last month
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆38Updated 2 months ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆50Updated last week
- Models and codes for INTERSPEECH 2023 paper DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model☆10Updated 10 months ago
- Official Implementation and Dataset of paper - DFADD: The Diffusion and Flow-matching based Audio Deepfake Dataset☆11Updated this week
- Code for ICASSP 2024 Paper: RECAP: Retrieval-Augmented Audio Captioning☆10Updated 5 months ago
- ☆21Updated 4 months ago
- Official implementation of the APSIPA 2022 paper: Exploring Speaker Age Estimation on Different Self-Supervised Learning Models☆12Updated 2 years ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆48Updated last month
- SCOREQ: Speech COntrastive REgression for Quality Assessment (NeurIPS 2024)☆38Updated last month
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆67Updated 2 weeks ago
- Repository having the code and models from the paper: data2vec-aqc: Search for the right Teaching Assistant in the Teacher-Student traini…☆11Updated 8 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆43Updated 2 weeks ago
- Python scripts to create noisy and reverberant 2-speaker mixture audio with Libri-Light and WHAM☆15Updated 2 weeks ago
- An unofficial implementation of "UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding".☆22Updated last year
- A deepfake audio dataset for detecting fake speech from codec-based speech synthesis systems, Interspeech 2024☆13Updated 3 months ago
- Contains the code associated with the ICLR submission for our text-to-speech diffusion model☆50Updated last year
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆30Updated last month
- Awesome Neural Codec Models, Text-to-Speech Synthesizers & Speech Language Models☆15Updated this week
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated 9 months ago
- ☆42Updated this week
- [ACMMM'2024] Generative Expressive Conversational Speech Synthesis☆28Updated 3 weeks ago
- ☆50Updated 9 months ago
- ☆51Updated 3 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆42Updated 3 weeks ago
- ☆13Updated last month
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month