VITA-MLLM / LUCYLinks
LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
☆54Updated 4 months ago
Alternatives and similar repositories for LUCY
Users that are interested in LUCY are comparing it to the libraries listed below
Sorting:
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆162Updated 4 months ago
- Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆164Updated 2 months ago
- ☆102Updated 2 weeks ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆50Updated last year
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆86Updated 3 months ago
- The open source code for LLM-Codec☆138Updated last year
- Audio-FLAN☆157Updated 5 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆153Updated this week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆111Updated 8 months ago
- Official release of StyleTalk dataset.☆69Updated last year
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆85Updated 9 months ago
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆138Updated 2 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆50Updated 3 months ago
- ☆92Updated 2 months ago
- ☆72Updated 2 weeks ago
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆35Updated 3 weeks ago
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆70Updated 3 months ago
- Code for DeSTA2.5-Audio☆108Updated 2 weeks ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆182Updated last year
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆207Updated 5 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆60Updated 7 months ago
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆94Updated 6 months ago
- EMO-SUPERB submission☆45Updated 11 months ago
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆60Updated this week
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆48Updated last year
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆149Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 9 months ago
- ☆18Updated 2 months ago
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆148Updated 3 weeks ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆181Updated 8 months ago