ZhikangNiu / Semantic-VAELinks
Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"
☆106Updated last month
Alternatives and similar repositories for Semantic-VAE
Users that are interested in Semantic-VAE are comparing it to the libraries listed below
Sorting:
- Trainging, inference, and testing of the SAC speech codec model.☆93Updated 3 months ago
- The demo page for ALMTokenizer☆55Updated 9 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆62Updated last month
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆43Updated last year
- [ACL 2025] OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching☆44Updated 11 months ago
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆56Updated 8 months ago
- The open source code of ALMTokenizer2: Towards Low bit-rate and Semantic-rich Audio Tokenizer with Flow-based Scalar Diffusion Transforme…☆42Updated 4 months ago
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆83Updated 4 months ago
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆41Updated 7 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆122Updated 5 months ago
- ☆99Updated 2 weeks ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆95Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆62Updated last year
- ☆68Updated last month
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆61Updated last year
- 5Hz Deep-Compression Speech VAE for AR-Diffusion and CALMs☆57Updated 2 months ago
- Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis☆27Updated 10 months ago
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆112Updated 7 months ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆84Updated last year
- This is the code for paper: XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecs. Demos, technical insigh…☆84Updated 4 months ago
- ☆30Updated 4 months ago
- This repo is text to speech with learnable audio encoder without alignment with transcript reference☆53Updated 4 months ago
- This repository contains a series of works on diffusion-based speech tokenizers, including the official implementation of the paper: "TaD…☆75Updated last week
- A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E2E Retrieval.☆27Updated 6 months ago
- ☆36Updated 4 months ago
- The open source code for SimpleSpeech series☆145Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- ☆61Updated last year
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆54Updated 8 months ago
- This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models☆35Updated last year