ddlBoJack / Omni-CaptionerLinks
Data Pipeline, Models, and Benchmark for Omni-Captioner.
☆114Updated 2 months ago
Alternatives and similar repositories for Omni-Captioner
Users that are interested in Omni-Captioner are comparing it to the libraries listed below
Sorting:
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆131Updated 3 months ago
- Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆104Updated 3 weeks ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆62Updated 11 months ago
- ☆24Updated 4 months ago
- [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?☆37Updated last month
- Trainging, inference, and testing of the SAC speech codec model.☆92Updated 2 months ago
- ☆68Updated last week
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆62Updated 2 weeks ago
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆40Updated 6 months ago
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆103Updated 2 months ago
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆82Updated 3 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆94Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆62Updated last year
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆95Updated last year
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆101Updated 8 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆68Updated this week
- The open-source code of UniAudio2.0☆74Updated 4 months ago
- ☆41Updated 9 months ago
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆58Updated 8 months ago
- The baselines of ARC-Challenge-Interspeech2026☆51Updated last month
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- [INTERSPEECH 2025 Oral]Official code for "Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment"☆64Updated 6 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆118Updated 4 months ago
- ☆37Updated last year
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆55Updated 7 months ago
- Audio-FLAN☆160Updated 3 months ago
- ☆27Updated 6 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆106Updated 7 months ago
- The demo page for ALMTokenizer☆55Updated 8 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆77Updated last year