ddlBoJack / Omni-CaptionerLinks
Data Pipeline, Models, and Benchmark for Omni-Captioner.
☆115Updated 3 months ago
Alternatives and similar repositories for Omni-Captioner
Users that are interested in Omni-Captioner are comparing it to the libraries listed below
Sorting:
- [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?☆39Updated 2 months ago
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆131Updated 4 months ago
- Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆106Updated last month
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆41Updated 7 months ago
- Trainging, inference, and testing of the SAC speech codec model.☆93Updated 3 months ago
- [AAAI 2026] DIFFA: Large Language Diffusion Models Can Listen and Understand☆49Updated 2 months ago
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆83Updated 4 months ago
- ☆68Updated last month
- ☆24Updated 4 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆62Updated last year
- The demo page for ALMTokenizer☆55Updated 9 months ago
- ☆29Updated 4 months ago
- ☆32Updated 7 months ago
- MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆122Updated 4 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆62Updated last year
- The open-source code of UniAudio2.0☆74Updated 4 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆69Updated last week
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆107Updated 3 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆62Updated last month
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆56Updated 8 months ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆104Updated 8 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆95Updated last year
- small audio language model for reasoning☆86Updated last month
- ☆37Updated last year
- Audio-FLAN☆160Updated 4 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆54Updated 8 months ago
- The baselines of ARC-Challenge-Interspeech2026☆56Updated 2 months ago
- MMSU Benchmark☆17Updated 7 months ago
- [INTERSPEECH 2025 Oral]Official code for "Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment"☆64Updated 7 months ago
- The open source code for LLM-Codec☆146Updated last year