kyutai-labs / moshi
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.
☆8,079Updated this week
Alternatives and similar repositories for moshi:
Users that are interested in moshi are comparing it to the libraries listed below
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,886Updated 5 months ago
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆3,964Updated 2 weeks ago
- tiny vision language model☆7,774Updated 2 weeks ago
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,279Updated 5 months ago
- Inference and training library for high-quality TTS models.☆5,188Updated 4 months ago
- A fast multimodal LLM for real-time voice☆3,824Updated 2 months ago
- Towards Human-Sounding Speech☆3,986Updated this week
- Fast and accurate automatic speech recognition (ASR) for edge devices☆2,672Updated last month
- SGLang is a fast serving framework for large language models and vision language models.☆13,215Updated this week
- Local realtime voice AI☆2,277Updated last month
- GLM-4-Voice | 端到端中英语音对话模型☆2,826Updated 4 months ago
- first base model for full-duplex conversational audio☆1,730Updated 3 months ago
- Open Source framework for voice and multimodal conversational AI☆5,543Updated this week
- Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junio…☆8,938Updated this week
- High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.☆5,927Updated 3 months ago
- The python library for real-time communication☆3,515Updated this week
- ☆4,150Updated last month
- A language model programming library.☆5,734Updated last month
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,611Updated last month
- Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"☆11,184Updated last week
- An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Spe…☆2,563Updated 2 weeks ago
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆899Updated 5 months ago
- A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcri…☆6,693Updated this week
- Zero-Shot Speech Editing and Text-to-Speech in the Wild☆8,239Updated last month
- Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…☆2,442Updated this week
- An Open Source text-to-speech system built by inverting Whisper.☆4,204Updated last week
- Speech-to-text, text-to-speech, speaker diarization, speech enhancement, and VAD using next-gen Kaldi with onnxruntime without Internet c…☆5,617Updated this week
- g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains☆4,209Updated 2 months ago
- Blazingly fast LLM inference.☆5,425Updated this week
- 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)☆6,295Updated 3 months ago