Official PyTorch implementation of "Paralinguistics-Aware Speech-Empowered LLMs for Natural Conversation" (NeurIPS 2024)
☆96Dec 3, 2024Updated last year
Alternatives and similar repositories for usdm
Users that are interested in usdm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An official implementation of "UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data"☆135Aug 17, 2023Updated 3 years ago
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆168Mar 26, 2026Updated 7 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆128Mar 20, 2025Updated last year
- The open source code for SimpleSpeech series☆147Oct 8, 2024Updated 2 years ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆78Nov 1, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆98Mar 12, 2025Updated last year
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆100Nov 9, 2024Updated 2 years ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆92Dec 20, 2024Updated last year
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆167Jun 13, 2024Updated 2 years ago
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆222Sep 19, 2024Updated 2 years ago
- ☆36Mar 14, 2025Updated last year
- The open source code for LLM-Codec☆147Aug 18, 2024Updated 2 years ago
- ☆174Sep 9, 2026Updated 2 months ago
- A family of state-of-the-art Transformer-based audio codecs for low-bitrate high-quality audio coding.☆446Jul 17, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆130Jun 4, 2025Updated last year
- Temporary anonymous version☆22Mar 20, 2024Updated 2 years ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆77Dec 3, 2025Updated 11 months ago
- PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-To-Speech Using Natural Language Descriptions☆87Oct 11, 2024Updated 2 years ago
- [InterSpeech 24] FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter☆99Jul 4, 2024Updated 2 years ago
- A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…☆124Sep 3, 2025Updated last year
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆160Jan 1, 2025Updated last year
- poorman's ar-dit tts☆45Dec 31, 2025Updated 10 months ago
- ☆19Aug 13, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆62Oct 23, 2024Updated 2 years ago
- ACM MM 2024 FlashSpeech: Efficient Zero-Shot Speech Synthesis☆159Sep 20, 2024Updated 2 years ago
- Text-To-Speech for NotebookLM☆40Jul 20, 2025Updated last year
- [ACL 2026] Rectifying the Emotional Flow: Aligning Priors and Dynamic Guidance for High-Arousal Text-to-Speech☆18Apr 29, 2026Updated 6 months ago
- ☆63Jan 15, 2024Updated 2 years ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆197Jul 12, 2024Updated 2 years ago
- Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling (Accepted by AAAI'2024)☆61Jun 20, 2024Updated 2 years ago
- [ACMMM'2024] Generative Expressive Conversational Speech Synthesis☆45Oct 28, 2024Updated 2 years ago
- Contains the code associated with the ICLR submission for our text-to-speech diffusion model☆57Oct 31, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆103Jan 19, 2026Updated 9 months ago
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆178Nov 30, 2025Updated 11 months ago
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆27Aug 5, 2024Updated 2 years ago
- Inference code for Interspeech 2025 paper, "LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec"☆38Oct 23, 2025Updated last year
- A Survey of Spoken Dialogue Models (60 pages)☆317Nov 28, 2024Updated last year
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆67Jan 16, 2025Updated last year
- [ICASSP 2024] TextrolSpeech: A Text Style Control Speech Corpus With Codec Language Text-to-Speech Models☆190Nov 22, 2024Updated last year
Are these results useful?