facebookresearch / spiritlm
Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
☆781Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for spiritlm
- Interface for OuteTTS models.☆406Updated 2 weeks ago
- Whisper with Medusa heads☆799Updated 2 weeks ago
- A fast multimodal LLM for real-time voice☆1,339Updated this week
- first base model for full-duplex conversational audio☆1,560Updated last week
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,230Updated 3 months ago
- Local SRT/LLM/TTS Voicechat☆544Updated last month
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,565Updated 2 weeks ago
- Open source inference code for Rev's model☆333Updated this week
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,092Updated 2 weeks ago
- ☆446Updated this week
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,571Updated last week
- StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.☆958Updated 2 months ago
- Janus-Series: Unified Multimodal Understanding and Generation Models☆1,084Updated last week
- Example UI implementing the RTVI web client☆471Updated last month
- ☆1,094Updated 5 months ago
- Have a natural voice conversation with an LLM☆224Updated last week
- Implementation of F5-TTS in MLX☆327Updated 2 weeks ago
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,490Updated 4 months ago
- Speech, Language, Audio, Music Processing with Large Language Model☆581Updated this week
- Joint speech-language model - respond directly to audio!☆356Updated 4 months ago
- ☆307Updated 2 months ago
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆438Updated this week
- OpenMusic: SOTA Text-to-music (TTM) Generation☆479Updated last week
- ☆253Updated 8 months ago
- Controllable and fast Text-to-Speech for over 7000 languages!☆1,464Updated 2 weeks ago
- podcastfy.ai gradio demo app☆311Updated this week
- Awesome speech/audio LLMs, representation learning, and codec models☆701Updated this week
- Local realtime voice AI☆1,946Updated this week
- Collection of Open Source Speech Data☆146Updated last week
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch☆355Updated 2 weeks ago