VITA-MLLM / LUCYLinks
LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
☆56Updated 6 months ago
Alternatives and similar repositories for LUCY
Users that are interested in LUCY are comparing it to the libraries listed below
Sorting:
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆168Updated 6 months ago
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆172Updated 4 months ago
- The open source code for LLM-Codec☆139Updated last year
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆90Updated 5 months ago
- ☆113Updated last month
- Audio-FLAN☆159Updated last month
- A Massive Contextual Speech Recognition Benchmark.☆91Updated 2 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆122Updated 10 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆52Updated last year
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆88Updated last week
- ☆101Updated last month
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆145Updated 4 months ago
- ☆75Updated 2 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆176Updated this week
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆139Updated 7 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆54Updated 5 months ago
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆73Updated 6 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 11 months ago
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆75Updated last month
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆214Updated 7 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆187Updated last year
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆105Updated last month
- small audio language model for reasoning☆80Updated 6 months ago
- Code for DeSTA2.5-Audio☆116Updated 2 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆62Updated 9 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆187Updated 10 months ago
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆39Updated last month
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆170Updated last week
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆90Updated 11 months ago
- A low-bitrate single-codebook 16 / 24 kHz speech codec based on focal modulation☆108Updated last month