ddlBoJack / Omni-CaptionerLinks
Data Pipeline, Models, and Benchmark for Omni-Captioner.
☆105Updated 2 months ago
Alternatives and similar repositories for Omni-Captioner
Users that are interested in Omni-Captioner are comparing it to the libraries listed below
Sorting:
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆81Updated 3 months ago
- Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆102Updated last month
- Trainging, inference, and testing of the SAC speech codec model.☆92Updated last month
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆40Updated 5 months ago
- The baselines of ARC-Challenge-Interspeech2026☆49Updated 2 weeks ago
- [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?☆37Updated last month
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆93Updated last year
- ☆24Updated 3 months ago
- The open-source code of UniAudio2.0☆73Updated 3 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆62Updated 11 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆62Updated last year
- The demo page for ALMTokenizer☆55Updated 8 months ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆100Updated 7 months ago
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Updated last year
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆54Updated 7 months ago
- The open source code for LLM-Codec☆143Updated last year
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆127Updated 3 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆58Updated 3 months ago
- Audio-FLAN☆160Updated 2 months ago
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆54Updated 6 months ago
- ☆81Updated 5 months ago
- ☆64Updated 2 weeks ago
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆40Updated 9 months ago
- ☆78Updated 4 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆116Updated 3 months ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆94Updated last year
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆149Updated 6 months ago
- Streaming Vocos☆29Updated 6 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆66Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆106Updated 7 months ago