VITA-MLLM / LUCY
LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
☆31Updated last week
Alternatives and similar repositories for LUCY:
Users that are interested in LUCY are comparing it to the libraries listed below
- ☆51Updated last month
- VoxInstruct: Expressive Human Instruction-to-Speech Generation with Unified Multilingual Codec Language Modelling☆67Updated 4 months ago
- The open source code for LLM-Codec☆132Updated 7 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆110Updated 2 months ago
- Official release of StyleTalk dataset.☆62Updated 8 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆52Updated 4 months ago
- A low-bitrate single-codebook 16 kHz speech codec based on focal modulation☆79Updated last month
- Audio-FLAN☆140Updated 3 weeks ago
- ☆69Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆48Updated 9 months ago
- LibriSpeech-Long is a benchmark dataset for long-form speech generation and processing. Released as part of "Long-Form Speech Generation …☆60Updated 2 months ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆48Updated 2 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆55Updated 4 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆33Updated last week
- UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sound☆114Updated last month
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆109Updated this week
- small audio language model for reasoning☆49Updated last week
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation (INTERSPEECH 2024)☆38Updated 9 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆83Updated 3 months ago
- ☆67Updated last week
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆64Updated 4 months ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆94Updated 5 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆43Updated 9 months ago
- ☆28Updated 8 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆69Updated this week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆138Updated last year
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆169Updated 8 months ago
- A trainer for SNAC (Multi-Scale Neural Audio Codec) has replaced the decoder with Vocos.☆32Updated 5 months ago
- ☆26Updated 6 months ago