VITA-MLLM / LUCY
LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
☆36Updated this week
Alternatives and similar repositories for LUCY:
Users that are interested in LUCY are comparing it to the libraries listed below
- ☆60Updated 3 weeks ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆71Updated 5 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆94Updated 5 months ago
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆84Updated this week
- small audio language model for reasoning☆58Updated this week
- The open source code for LLM-Codec☆132Updated 8 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆57Updated 5 months ago
- Official release of StyleTalk dataset.☆62Updated 9 months ago
- UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sound☆119Updated last month
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 5 months ago
- Audio-FLAN☆142Updated last month
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆120Updated this week
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 10 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆48Updated 3 months ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆67Updated 7 months ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆48Updated 5 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆89Updated 4 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆49Updated 9 months ago
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆26Updated last month
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆36Updated last week
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆62Updated 3 months ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆82Updated 5 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆133Updated this week
- UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Prompts☆28Updated 3 months ago
- llama-omni训练代码复现☆59Updated 2 months ago
- ☆34Updated 2 weeks ago
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆84Updated 2 months ago
- ☆69Updated last year
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆42Updated 3 months ago
- ☆46Updated 3 months ago