kyutai-labs / moshi
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.
☆7,812Updated this week
Alternatives and similar repositories for moshi:
Users that are interested in moshi are comparing it to the libraries listed below
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,857Updated 4 months ago
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆3,874Updated last week
- Inference and training library for high-quality TTS models.☆5,129Updated 3 months ago
- A fast multimodal LLM for real-time voice☆3,712Updated last month
- Open Source framework for voice and multimodal conversational AI☆5,200Updated this week
- Fast and accurate automatic speech recognition (ASR) for edge devices☆2,633Updated 2 weeks ago
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,217Updated 4 months ago
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,195Updated last month
- first base model for full-duplex conversational audio☆1,716Updated 2 months ago
- A language model programming library.☆5,672Updated 3 weeks ago
- SGLang is a fast serving framework for large language models and vision language models.☆11,970Updated this week
- Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization☆4,085Updated last week
- Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"☆10,318Updated this week
- Local realtime voice AI☆2,256Updated 2 weeks ago
- Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junio…☆8,693Updated 2 weeks ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆11,810Updated this week
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,523Updated this week
- Multilingual Voice Understanding Model☆4,944Updated 2 months ago
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆887Updated 4 months ago
- SOTA Open Source TTS☆20,022Updated 2 weeks ago
- tiny vision language model☆7,642Updated 3 weeks ago
- Build real-time multimodal AI applications 🤖🎙️📹☆5,299Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,265Updated last week
- Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥☆34,984Updated this week
- SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer☆3,696Updated this week
- ☆2,884Updated 6 months ago