naver-ai / usdm
Official PyTorch implementation of "Paralinguistics-Aware Speech-Empowered LLMs for Natural Conversation" (NeurIPS 2024)
☆86Updated 4 months ago
Alternatives and similar repositories for usdm:
Users that are interested in usdm are comparing it to the libraries listed below
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆78Updated last month
- The open source code for LLM-Codec☆133Updated 8 months ago
- The open source code for SimpleSpeech series☆138Updated 6 months ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆129Updated 10 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 5 months ago
- UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sound☆118Updated last month
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆62Updated 3 months ago
- ☆59Updated 5 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆74Updated 5 months ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆64Updated 5 months ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆50Updated 5 months ago
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆118Updated last month
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆74Updated 10 months ago
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆131Updated 10 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆57Updated 5 months ago
- An official implementation of "UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data"☆134Updated last year
- The demo page for ALMTokenizer☆42Updated last week
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- Official Implementation of EnCLAP (ICASSP 2024)☆91Updated 10 months ago
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆52Updated 6 months ago
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆85Updated 2 months ago
- ☆68Updated 7 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆175Updated 9 months ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆57Updated 2 weeks ago
- ACM MM 2024 FlashSpeech: Efficient Zero-Shot Speech Synthesis☆135Updated 7 months ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆67Updated 8 months ago
- ☆141Updated 7 months ago
- ☆63Updated last year
- [InterSpeech 24] FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter☆90Updated 9 months ago
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆38Updated 10 months ago