Alternatives and similar repositories for OpenOmni

Users that are interested in OpenOmni are comparing it to the libraries listed below

• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆74Updated 8 months ago
• HarryHsing / EchoInk
  EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…
  ☆68Updated 6 months ago
• threegold116 / Awesome-Omni-MLLMs
  This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels
  ☆77Updated last month
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆52Updated 8 months ago
• HumanMLLM / Omni-Emotion
  ☆21Updated 10 months ago
• GiantAILab / DeepDubber-V1
  DeepDubber-V1: Towards High Quality and Dialogue, Narration, Monologue Adaptive Movie Dubbing Via Multi-Modal Chain-of-Thoughts Reasoning…
  ☆26Updated 3 months ago
• baichuan-inc / Baichuan-Omni-1.5
  ☆182Updated 10 months ago
• OmniMMI / OpenOmniNexus
  a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
  ☆35Updated 8 months ago
• BriansIDP / video-SALMONN-o1
  ☆37Updated 3 months ago
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆85Updated 2 months ago
• bytedance / video-SALMONN-2
  video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…
  ☆126Updated last month
• zhuyjan / MER2025-MRAC25
  [ACM-MM 2025 Workshop] More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment.
  ☆25Updated 2 weeks ago
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆272Updated 10 months ago
• HumanMLLM / HumanOmni
  HumanOmni
  ☆208Updated 9 months ago
• wntg / LLaMA-Omni
  llama-omni训练代码复现
  ☆72Updated 10 months ago
• CASIA-LM / OpenS2S
  OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model
  ☆96Updated 4 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 7 months ago
• jianganbai / FISHER
  A Foundation Model for Industrial Signal Comprehensive Representation
  ☆54Updated 4 months ago
• NKU-HLT / DIFFA
  [AAAI 2026] DIFFA: Large Language Diffusion Models Can Listen and Understand
  ☆37Updated last month
• xiaomi-research / r1-aqa
  🤗 R1-AQA Model: mispeech/r1-aqa
  ☆308Updated 8 months ago
• InternLM / StarBench
  ☆34Updated last month
• GiantAILab / DeepSound-V1
  Official code for DeepSound-V1
  ☆13Updated 6 months ago
• Aurora-slz / Synth-Empathy
  Synth-Empathy: Towards High-Quality Synthetic Empathy Data
  ☆17Updated 9 months ago
• HumanMLLM / CoGenAV
  ☆61Updated 5 months ago
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆124Updated last year
• Sakshi113 / MMAU
  ☆121Updated 3 months ago
• SpeechEE / SpeechEE
  ☆11Updated 3 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆56Updated 7 months ago
• Callione / LLaVA-MOSS2
  Modified LLaVA framework for MOSS2, and makes MOSS2 a multimodal model.
  ☆13Updated last year
• Tencent / VITA
  The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.
  ☆130Updated last month