第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。
☆560Sep 11, 2023Updated 3 years ago
Alternatives and similar repositories for LLaSM
Users that are interested in LLaSM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SpeechGPT Series: Speech Large Language Models☆1,401Jul 22, 2024Updated 2 years ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆666Jun 9, 2024Updated 2 years ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆521Jul 3, 2026Updated 4 months ago
- The Open Source Code of UniAudio☆609Jul 22, 2024Updated 2 years ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆152Sep 14, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GPT-style network for phonemization with durations of text☆68Mar 21, 2024Updated 2 years ago
- Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (…☆60Apr 4, 2024Updated 2 years ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆197Jul 12, 2024Updated 2 years ago
- SALMONN family: A suite of advanced multi-modal LLMs☆1,566Oct 16, 2026Updated 3 weeks ago
- ☆260May 15, 2023Updated 3 years ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆272May 19, 2024Updated 2 years ago
- E2E TTS using Conditional Flow Matching (Experimental*)☆71Nov 10, 2023Updated 2 years ago
- AcademiCodec: An Open Source Audio Codec Model for Academic Research☆676Dec 27, 2023Updated 2 years ago
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Sep 4, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- VoiceLDM: Text-to-Speech with Environmental Context☆193Aug 9, 2024Updated 2 years ago
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆449Jan 25, 2024Updated 2 years ago
- The reproduced code for Google's SoundStorm☆276Oct 7, 2023Updated 3 years ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆77Jun 9, 2023Updated 3 years ago
- ☆25Mar 12, 2022Updated 4 years ago
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆375Sep 3, 2024Updated 2 years ago
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,957Jul 5, 2024Updated 2 years ago
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆214Jan 18, 2024Updated 2 years ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆130Jun 11, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Train the next generation of TTS systems.☆169Sep 13, 2024Updated 2 years ago
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆166Jun 13, 2024Updated 2 years ago
- KAN-TTS is a speech-synthesis training framework, please try the demos we have posted at https://modelscope.cn/models?page=1&tasks=text-…☆529Dec 28, 2023Updated 2 years ago
- Next-generation TTS model using flow-matching and DiT, inspired by Stable Diffusion 3☆440Sep 13, 2024Updated 2 years ago
- Official Implement of Multi-Stage Multi-Codebook (MSMC) TTS☆168Apr 10, 2024Updated 2 years ago
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆747Updated this week
- ☆204Sep 24, 2024Updated 2 years ago
- text to speech using autoregressive transformer and VITS☆248Apr 3, 2024Updated 2 years ago
- An ODE-based generative neural vocoder using Rectified Flow☆58Apr 29, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆180Jul 9, 2024Updated 2 years ago
- [ACL 2025 Oral] Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models☆208Jun 25, 2025Updated last year
- An Open-source Streaming High-fidelity Neural Audio Codec☆515Mar 4, 2025Updated last year
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆206Jun 7, 2026Updated 4 months ago
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆26Aug 5, 2024Updated 2 years ago
- This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.☆602Sep 18, 2023Updated 3 years ago
- Awesome speech/audio LLMs, representation learning, and codec models☆1,248Jul 10, 2026Updated 3 months ago