Alternatives and similar repositories for mini-omni2:

Users that are interested in mini-omni2 are comparing it to the libraries listed below

• gpt-omni / mini-omni
  open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…
  ☆3,176Updated 3 months ago
• facebookresearch / spiritlm
  Inference code for the paper "Spirit-LM Interleaved Spoken and Written Language Model".
  ☆882Updated 4 months ago
• om-ai-lab / OmAgent
  Build multimodal language agents for fast prototype and production
  ☆2,101Updated last week
• VITA-MLLM / VITA
  ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
  ☆2,122Updated 2 weeks ago
• fudan-generative-vision / hallo3
  Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Diffusion Transformer Networks
  ☆1,092Updated this week
• fudan-generative-vision / hallo2
  Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation
  ☆3,493Updated this week
• QwenLM / Qwen2-Audio
  The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
  ☆1,544Updated 6 months ago
• jishengpeng / WavTokenizer
  [ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
  ☆1,033Updated this week
• NexaAI / nexa-sdk
  Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language m…
  ☆4,407Updated this week
• edwko / OuteTTS
  Interface for OuteTTS models.
  ☆940Updated 2 weeks ago
• ivcylc / OpenMusic
  OpenMusic: SOTA Text-to-music (TTM) Generation
  ☆531Updated last week
• FreedomIntelligence / HuatuoGPT-o1
  Medical o1, Towards medical complex reasoning with LLMs
  ☆916Updated last month
• PKU-Alignment / align-anything
  Align Anything: Training All-modality Model with Feedback
  ☆2,486Updated this week
• VITA-MLLM / Freeze-Omni
  ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM
  ☆280Updated 2 months ago
• HKUDS / MiniRAG
  "MiniRAG: Making RAG Simpler with Small and Free Language Models"
  ☆807Updated this week
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆2,830Updated 3 months ago
• Standard-Intelligence / hertz-dev
  first base model for full-duplex conversational audio
  ☆1,713Updated last month
• HITsz-TMG / UMOE-Scaling-Unified-Multimodal-LLMs
  The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"
  ☆694Updated last month
• rhymes-ai / Aria
  Codebase for Aria - an Open Multimodal Native MoE
  ☆1,007Updated last month
• HITsz-TMG / FilmAgent
  Resources of our paper "FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spaces". New versions in the maki…
  ☆898Updated last week
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆770Updated this week
• ShareGPT4Omni / ShareGPT4Video
  [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
  ☆1,041Updated 4 months ago
• THUDM / GLM-4-Voice
  GLM-4-Voice | 端到端中英语音对话模型
  ☆2,705Updated 2 months ago
• Vchitect / Vchitect-2.0
  Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models
  ☆888Updated last month
• rhymes-ai / Allegro
  Allegro is a powerful text-to-video model that generates high-quality videos up to 6 seconds at 15 FPS and 720p resolution from simple te…
  ☆1,055Updated 3 weeks ago
• FunAudioLLM / InspireMusic
  InspireMusic: A Unified Framework for Music, Song, Audio Generation.
  ☆903Updated this week