VITA-MLLM / LUCY
LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
☆37Updated 3 weeks ago
Alternatives and similar repositories for LUCY:
Users that are interested in LUCY are comparing it to the libraries listed below
- ☆66Updated last month
- The open source code for LLM-Codec☆133Updated 8 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆124Updated 3 weeks ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆58Updated 6 months ago
- ☆59Updated last week
- Official release of StyleTalk dataset.☆62Updated 10 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆48Updated 3 months ago
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆74Updated 6 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 6 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆96Updated 5 months ago
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆91Updated 3 weeks ago
- ☆70Updated last year
- small audio language model for reasoning☆61Updated 3 weeks ago
- Audio-FLAN☆142Updated 2 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆49Updated 10 months ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆83Updated 5 months ago
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)☆35Updated last month
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 11 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆68Updated 6 months ago
- UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sound☆118Updated 2 months ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆64Updated 5 months ago
- The open source code for SimpleSpeech series☆138Updated 7 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆175Updated 9 months ago
- This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".☆138Updated 2 weeks ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆51Updated 6 months ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆129Updated 4 months ago
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆86Updated 2 months ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆67Updated 8 months ago
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆119Updated last month
- UMETTS: A Unified Framework for Emotional Text-to-Speech Synthesis with Multimodal Prompts☆28Updated 4 months ago