ictnlp / Stream-OmniLinks
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.
☆339Updated last month
Alternatives and similar repositories for Stream-Omni
Users that are interested in Stream-Omni are comparing it to the libraries listed below
Sorting:
- High-quality and streaming Speech-to-Speech interactive agent in a single file. 只用一个文件实现的流式全双工语音交互原型智能体!☆461Updated last month
- PengChengStarling is specifically designed for developing multilingual ASR models based on the icefall project, supporting a complete ASR…☆186Updated 5 months ago
- ☆133Updated last week
- Stay ahead of AI trends with automated Reddit insights! 🚀 This tool scans AI-related Reddit communities in English & Chinese, using Redd…☆191Updated this week
- ☆429Updated 3 months ago
- GPT-4o-level, real-time spoken dialogue system.☆348Updated 6 months ago
- ☆289Updated 3 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆136Updated 2 months ago
- Github repository for ACL 2025 paper: Recent Advances in Speech Language Models: A Survey.☆121Updated last month
- ☆201Updated 10 months ago
- MOSS-TTSD is a spoken dialogue generation model that enables expressive dialogue speech synthesis in both Chinese and English, supporting…☆637Updated last week
- ☆447Updated 2 months ago
- Doge Family of Small Language Models☆159Updated this week
- Dolphin is a multilingual, multitask ASR model jointly trained by DataoceanAI and Tsinghua University.☆579Updated 3 weeks ago
- PodAgent: A Comprehensive Framework for Podcast Generation☆113Updated 2 months ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆284Updated 4 months ago
- 🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.☆87Updated last month
- ☆235Updated 5 months ago
- LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in …☆516Updated last month
- Official Repository of paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆144Updated 5 months ago
- RealSI: Open Benchmark for Simultaneous Interpretation in Real-world Scenarios☆62Updated last month
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统,使用在线API服务,支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆60Updated 2 months ago
- StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.☆1,126Updated last month
- Extension of ChatTTS, 3x Faster on Windows, Support Voice Cloning and Mobile Deployment☆169Updated 5 months ago
- ☆185Updated 3 months ago
- ☆260Updated 11 months ago
- ☆166Updated 5 months ago
- We Speech Transcript based on LLM, in 300 lines of code.☆174Updated last month
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆66Updated 3 weeks ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆333Updated 2 months ago