gpt-omni / mini-omni
open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
☆3,066Updated 2 months ago
Alternatives and similar repositories for mini-omni:
Users that are interested in mini-omni are comparing it to the libraries listed below
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,550Updated this week
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,395Updated 5 months ago
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆2,746Updated 2 months ago
- GLM-4-Voice | 端到端中英语音对话模型☆2,565Updated last month
- ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆1,932Updated this week
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,553Updated 6 months ago
- ☆7,156Updated this week
- Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".☆863Updated 2 months ago
- Interface for OuteTTS models.☆859Updated this week
- first base model for full-duplex conversational audio☆1,669Updated last week
- Multilingual Voice Understanding Model☆4,097Updated last week
- GPT4V-level open-source multi-modal model based on Llama3-8B☆2,204Updated 4 months ago
- Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation☆3,419Updated last month
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆3,679Updated last month
- SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling☆896Updated 2 weeks ago
- OpenMusic: SOTA Text-to-music (TTM) Generation☆502Updated 2 weeks ago
- TEN Agent is a conversational AI powered by the TEN, integrating Gemini 2.0 Live, OpenAI Realtime, RTC, and more. It delivers real-time c…☆3,897Updated this week
- Build multimodal language agents for very fast prototype and production☆1,198Updated this week
- Taming Stable Diffusion for Lip Sync!☆1,856Updated this week
- Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"☆818Updated 4 months ago
- Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language m…☆4,247Updated last week
- StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.☆1,000Updated 4 months ago
- A fast multimodal LLM for real-time voice☆2,760Updated this week
- Local SRT/LLM/TTS Voicechat☆590Updated 3 months ago
- Inference and training library for high-quality TTS models.☆4,910Updated last month
- SpeechGPT Series: Speech Large Language Models☆1,326Updated 5 months ago
- EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation☆2,328Updated this week
- An AI-Powered Speech Processing Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Enhancement, Separation, and Target Spe…☆2,014Updated this week
- MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone☆13,445Updated this week
- mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding☆2,015Updated 3 weeks ago