naver-ai / usdm
Official PyTorch implementation of "Paralinguistics-Aware Speech-Empowered LLMs for Natural Conversation" (NeurIPS 2024)
☆76Updated last month
Alternatives and similar repositories for usdm:
Users that are interested in usdm are comparing it to the libraries listed below
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆70Updated 4 months ago
- The open source code for LLM-Codec☆123Updated 5 months ago
- [InterSpeech 24] FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter☆86Updated 6 months ago
- The open source code for SimpleSpeech series☆122Updated 3 months ago
- ACM MM 2024 FlashSpeech: Efficient Zero-Shot Speech Synthesis☆120Updated 4 months ago
- ☆56Updated 3 months ago
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆52Updated last month
- ☆46Updated 2 months ago
- ☆65Updated last week
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆120Updated 7 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆61Updated 2 months ago
- ☆136Updated 4 months ago
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- Code for the paper "FLowHigh: Towards efficient and high-quality audio super-resolution with single-step flow matching"☆51Updated 2 weeks ago
- Official repo of ICASSP 2024 paper - Generative De-Quantization for Neural Speech Codec via Latent Diffusion.☆48Updated 3 weeks ago
- The official implementation of EmoSphere++☆70Updated last week
- An official implementation of "UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data"☆133Updated last year
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆126Updated 7 months ago
- SCOREQ: Speech COntrastive REgression for Quality Assessment (NeurIPS 2024)☆63Updated this week
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆64Updated 2 months ago
- Code for vec2wav 2.0, a speech token vocoder for VC. Paper: https://arxiv.org/abs/2409.01995☆67Updated last month
- ☆65Updated last year
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆123Updated 4 months ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆60Updated 9 months ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆84Updated 2 months ago
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆49Updated 3 months ago
- [Findings of NAACL 2024] Source code of paper CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers a…☆65Updated 10 months ago
- All generative model in one for better TTS model☆66Updated 4 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆82Updated 3 weeks ago
- ☆64Updated last year