ictnlp / Stream-OmniLinks
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.
☆357Updated 5 months ago
Alternatives and similar repositories for Stream-Omni
Users that are interested in Stream-Omni are comparing it to the libraries listed below
Sorting:
- High-quality and streaming Speech-to-Speech interactive agent in a single file. 只用一个文件实现的流式全双工语音交互原型智能体！☆473Updated 5 months ago
- PengChengStarling is specifically designed for developing multilingual ASR models based on the icefall project, supporting a complete ASR…☆182Updated 8 months ago
- We present StableAvatar, the first end-to-end video diffusion transformer, which synthesizes infinite-length high-quality audio-driven av…☆1,130Updated last month
- ☆128Updated 2 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆138Updated 6 months ago
- This is the official repo for the paper "LongCat-Flash-Omni Technical Report"☆413Updated last week
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆176Updated 3 weeks ago
- ☆471Updated 6 months ago
- GPT-4o-level, real-time spoken dialogue system.☆360Updated 10 months ago
- Github repository for ACL 2025 paper: Recent Advances in Speech Language Models: A Survey.☆151Updated 5 months ago
- GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation☆563Updated this week
- Windows下的claude code配置可视化管理工具☆228Updated this week
- ☆329Updated 7 months ago
- Doge Family of Small Language Models☆184Updated 3 months ago
- Ultra-low bitrate speech codec (0.27-1 kbps) with cross-modal alignment and real-time capabilities☆71Updated 3 months ago
- Official implementation of our NeurIPS 2025 paper: "FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mix…☆115Updated 3 weeks ago
- Official Repository of ACL 2025 paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆144Updated 8 months ago
- ☆176Updated 7 months ago
- 🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.☆77Updated 5 months ago
- Efficient audio understanding with general audio captions☆381Updated 3 weeks ago
- LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in …☆544Updated 4 months ago
- Extension of ChatTTS, 3x Faster on Windows, Support Voice Cloning and Mobile Deployment☆172Updated 9 months ago
- This is the code related to "🔥Effective Training Data Synthesis for Improving MLLM Chart Understanding" (ICCV 2025).☆73Updated 3 months ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆306Updated 7 months ago
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆382Updated 2 weeks ago
- PodAgent: A Comprehensive Framework for Podcast Generation☆121Updated 6 months ago
- RealSI: Open Benchmark for Simultaneous Interpretation in Real-world Scenarios☆73Updated 4 months ago
- VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Model☆344Updated 7 months ago
- OpenLens AI: Fully Autonomous Multimodal Agent for Health Informatics Research☆131Updated this week
- Dolphin is a multilingual, multitask ASR model jointly trained by DataoceanAI and Tsinghua University.☆661Updated 4 months ago