ictnlp / Stream-OmniLinks
Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.
☆382Updated 7 months ago
Alternatives and similar repositories for Stream-Omni
Users that are interested in Stream-Omni are comparing it to the libraries listed below
Sorting:
- High-quality and streaming Speech-to-Speech interactive agent in a single file. 只用一个文件实现的流式全双工语音交互原型智能体！☆492Updated last month
- PengChengStarling is specifically designed for developing multilingual ASR models based on the icefall project, supporting a complete ASR…☆185Updated 10 months ago
- Pytorch Implementation of the paper "M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesis"☆110Updated last month
- We present StableAvatar, the first end-to-end video diffusion transformer, which synthesizes infinite-length high-quality audio-driven av…☆1,198Updated last week
- Ultra-low bitrate speech codec (0.27-1 kbps) with cross-modal alignment and real-time capabilities☆213Updated 5 months ago
- This is the official repo for the paper "LongCat-Flash-Omni Technical Report"☆470Updated last week
- ☆143Updated 4 months ago
- Fun-Audio-Chat is a Large Audio Language Model built for natural, low-latency voice interactions.☆711Updated last week
- Official code for"DiaMoE-TTS: A Unified IPA-based Dialect TTS Framework with Mixture-of-Experts and Parameter-Efficient Zero-Shot Adaptat…☆222Updated 2 months ago
- Official implementation of our NeurIPS 2025 paper: "FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mix…☆176Updated 2 months ago
- GPT-4o-level, real-time spoken dialogue system.☆369Updated last year
- GLM-ASR-Nano: A robust, open-source speech recognition model with 1.5B parameters☆700Updated last month
- A Fully Self-Hosted Solution for Full-Duplex Voice Interaction☆468Updated 4 months ago
- ☆343Updated 9 months ago
- Fun-ASR is an end-to-end speech recognition large model launched by Tongyi Lab.☆793Updated 2 weeks ago
- Github repository for ACL 2025 paper: Recent Advances in Speech Language Models: A Survey.☆173Updated 7 months ago
- ☆484Updated 8 months ago
- ☆204Updated last year
- Efficient audio understanding with general audio captions☆398Updated 2 months ago
- MiMo-Audio: Audio Language Models are Few-Shot Learners☆963Updated 4 months ago
- OpenLens AI: A Fully Autonomous Multimodal Research Agent｜ OpenLens AI：全自主多模态科研智能体☆221Updated this week
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆426Updated 2 months ago
- Doge Family of Small Language Models☆183Updated 3 weeks ago
- 🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.☆77Updated 7 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆148Updated 8 months ago
- llama-omni训练代码复现☆73Updated last year
- Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测，知己知彼。☆267Updated last week
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆216Updated 11 months ago
- LongCat Audio Tokenizer and Detokenizer☆282Updated last week
- GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation☆854Updated this week