kyutai-labs / moshi
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.
☆7,875Updated this week
Alternatives and similar repositories for moshi:
Users that are interested in moshi are comparing it to the libraries listed below
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,861Updated 4 months ago
- A fast multimodal LLM for real-time voice☆3,757Updated last month
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆3,898Updated 2 weeks ago
- Local realtime voice AI☆2,260Updated 3 weeks ago
- Inference and training library for high-quality TTS models.☆5,148Updated 3 months ago
- Fast and accurate automatic speech recognition (ASR) for edge devices☆2,640Updated 3 weeks ago
- Build real-time multimodal AI applications 🤖🎙️📹☆5,343Updated this week
- first base model for full-duplex conversational audio☆1,722Updated 2 months ago
- Open Source framework for voice and multimodal conversational AI☆5,298Updated this week
- Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junio…☆8,831Updated 2 weeks ago
- Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"☆10,510Updated this week
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,226Updated 4 months ago
- SOTA Open Source TTS☆20,165Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆15,432Updated this week
- https://hf.co/hexgrad/Kokoro-82M☆1,825Updated this week
- StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models☆5,560Updated 7 months ago
- SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.☆5,735Updated this week
- 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)☆6,220Updated 2 months ago
- Blazingly fast LLM inference.☆5,240Updated this week
- Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.☆3,793Updated 2 months ago
- Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model☆7,257Updated last month
- The Memory layer for AI Agents☆26,530Updated this week
- Interface for OuteTTS models.☆955Updated last month
- Controllable and fast Text-to-Speech for over 7000 languages!☆1,566Updated 4 months ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,729Updated 7 months ago
- An Open Source text-to-speech system built by inverting Whisper.☆4,164Updated 3 months ago