WWWWxp / M3-TTSLinks
Pytorch Implementation of the paper "M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesis"
☆84Updated last week
Alternatives and similar repositories for M3-TTS
Users that are interested in M3-TTS are comparing it to the libraries listed below
Sorting:
- Ultra-low bitrate speech codec (0.27-1 kbps) with cross-modal alignment and real-time capabilities☆164Updated 3 months ago
- Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations…☆374Updated 6 months ago
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆204Updated 2 weeks ago
- ☆65Updated 2 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆67Updated 2 weeks ago
- Data Pipeline, Models, and Benchmark for Omni-Captioner.☆99Updated 2 months ago
- Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆102Updated last month
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆40Updated 5 months ago
- ☆22Updated 5 months ago
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆124Updated 8 months ago
- ☆81Updated 5 months ago
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆109Updated 6 months ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆100Updated 7 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆106Updated 6 months ago
- A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E2E Retrieval.☆25Updated 5 months ago
- Streaming Vocos☆29Updated 6 months ago
- Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis☆27Updated 8 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆93Updated last year
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆123Updated 2 months ago
- ☆64Updated last week
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆116Updated 3 months ago
- The demo page for ALMTokenizer☆55Updated 8 months ago
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆133Updated 2 weeks ago
- ☆61Updated last year
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆58Updated 2 months ago
- The open-source code of UniAudio2.0☆73Updated 3 months ago
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆43Updated last year
- ☆24Updated 3 months ago
- The baselines of ARC-Challenge-Interspeech2026☆47Updated 2 weeks ago
- ☆78Updated 4 months ago