gpt-omni / mini-omni
open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
☆2,425Updated this week
Related projects: ⓘ
- The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,069Updated last month
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆891Updated last week
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,390Updated 2 months ago
- Mobile-Agent: The Powerful Mobile Device Operation Assistant Family☆2,677Updated 2 weeks ago
- Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.☆1,904Updated this week
- Multilingual Voice Understanding Model☆2,625Updated 2 weeks ago
- GPT4V-level open-source multi-modal model based on Llama3-8B☆1,976Updated 2 weeks ago
- DeepSeek-VL: Towards Real-World Vision-Language Understanding☆2,007Updated 4 months ago
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆751Updated this week
- MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.☆6,824Updated last week
- Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding☆3,277Updated last month
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆2,989Updated last week
- [ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.☆1,742Updated 2 weeks ago
- SpeechGPT Series: Speech Large Language Models☆1,219Updated last month
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model☆3,415Updated last month
- Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation☆9,151Updated this week
- Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"☆742Updated 3 weeks ago
- Whisper with Medusa heads☆774Updated last week
- Inference and training library for high-quality TTS models.☆4,193Updated last month
- Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance☆3,909Updated 2 months ago
- The open source platform for AI-native application development.☆6,038Updated last week
- The official repository of the paper "(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long…☆564Updated 2 months ago
- MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators☆1,272Updated last month
- BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI…☆8,587Updated this week
- InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output☆2,449Updated 2 weeks ago
- V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.☆2,182Updated 2 months ago
- Multilingual and Controllable Text-to-Speech Toolkit of the Speech and Language Technologies Group at the University of Stuttgart.☆1,374Updated this week
- Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration☆1,521Updated 3 months ago
- An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)☆3,730Updated 3 weeks ago
- [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.☆4,742Updated last week