facebookresearch / spiritlm
Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
☆755Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for spiritlm
- Whisper with Medusa heads☆800Updated last week
- Interface for OuteTTS models.☆317Updated this week
- first base model for full-duplex conversational audio☆1,362Updated this week
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,538Updated last month
- Open source inference code for Rev's model☆331Updated 2 weeks ago
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,202Updated 2 months ago
- Local SRT/LLM/TTS Voicechat☆535Updated last month
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,515Updated this week
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆432Updated 3 weeks ago
- Llama3.1 learns to Listen☆1,749Updated last week
- Joint speech-language model - respond directly to audio!☆355Updated 4 months ago
- ☆1,092Updated 4 months ago
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch☆340Updated last week
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,067Updated last week
- Have a natural voice conversation with an LLM☆222Updated this week
- Controllable and fast Text-to-Speech for over 7000 languages!☆1,448Updated this week
- ☆303Updated 2 months ago
- ☆443Updated this week
- ⚡ Insanely fast AI voice assistant with <500ms response times☆302Updated 2 months ago
- ☆251Updated 7 months ago
- A fast multimodal LLM for real-time voice☆980Updated this week
- Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"☆774Updated 2 months ago
- Example UI implementing the RTVI web client☆471Updated last month
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,478Updated 4 months ago
- Gemma 2 optimized for your local machine.☆344Updated 3 months ago
- Speech, Language, Audio, Music Processing with Large Language Model☆571Updated this week
- [ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching☆723Updated 2 weeks ago
- Implementation of F5-TTS in MLX☆311Updated last week
- Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch☆610Updated last month
- Codebase for Aria - an Open Multimodal Native MoE☆787Updated this week