VITA-MLLM / LUCYLinks
LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
☆55Updated 5 months ago
Alternatives and similar repositories for LUCY
Users that are interested in LUCY are comparing it to the libraries listed below
Sorting:
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆164Updated 5 months ago
- Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆166Updated 3 months ago
- The open source code for LLM-Codec☆138Updated last year
- ☆108Updated last week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆116Updated 9 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆50Updated last year
- ☆95Updated 2 weeks ago
- Audio-FLAN☆158Updated 6 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆183Updated last year
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆86Updated 10 months ago
- A Massive Contextual Speech Recognition Benchmark.☆85Updated last month
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆53Updated 4 months ago
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆207Updated 6 months ago
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆76Updated 4 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆158Updated 2 weeks ago
- A large-scale speech corpus introduced in Spark-TTS, built from diverse open-source datasets for training text-to-speech (TTS) systems.☆87Updated 4 months ago
- Official release of StyleTalk dataset.☆69Updated last year
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆48Updated last year
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆61Updated 10 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆149Updated 2 years ago
- ☆73Updated last month
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆135Updated 5 months ago
- ☆143Updated 3 weeks ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆183Updated 9 months ago
- The repoduction codes for Qwen-Audio Fine-tuning☆46Updated last year
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆73Updated 4 months ago
- FlashCosyVoice: A lightweight vLLM implementation built from scratch for CosyVoice.☆158Updated last month
- [ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and s…☆142Updated 3 months ago
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆36Updated last week
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆61Updated 10 months ago