Alternatives and similar repositories for OpenOmni

Users that are interested in OpenOmni are comparing it to the libraries listed below

• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆74Updated 7 months ago
• threegold116 / Awesome-Omni-MLLMs
  This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels
  ☆60Updated last month
• HarryHsing / EchoInk
  EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…
  ☆60Updated 5 months ago
• GiantAILab / DeepDubber-V1
  DeepDubber-V1: Towards High Quality and Dialogue, Narration, Monologue Adaptive Movie Dubbing Via Multi-Modal Chain-of-Thoughts Reasoning…
  ☆25Updated last month
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆48Updated 7 months ago
• baichuan-inc / Baichuan-Omni-1.5
  ☆178Updated 8 months ago
• HumanMLLM / Omni-Emotion
  ☆21Updated 9 months ago
• BriansIDP / video-SALMONN-o1
  ☆35Updated 2 months ago
• OmniMMI / OpenOmniNexus
  a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
  ☆27Updated 6 months ago
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆268Updated 9 months ago
• bytedance / video-SALMONN-2
  video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…
  ☆98Updated last week
• zhuyjan / MER2025-MRAC25
  [ACM-MM 2025 Workshop] More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment.
  ☆24Updated last month
• GiantAILab / DeepSound-V1
  Official code for DeepSound-V1
  ☆12Updated 5 months ago
• wntg / LLaMA-Omni
  llama-omni训练代码复现
  ☆68Updated 9 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 6 months ago
• HumanMLLM / HumanOmni
  HumanOmni
  ☆201Updated 7 months ago
• ZHZisZZ / dllm
  dLLM: Simple Diffusion Language Modeling
  ☆177Updated this week
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆81Updated last month
• InternLM / StarBench
  ☆24Updated this week
• jindongli-Ai / LLM-Discrete-Tokenization-Survey
  The official GitHub page for the survey paper "Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey". And this paper is unde…
  ☆65Updated 2 months ago
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆118Updated last year
• FrankYang-17 / MME-VideoOCR
  ☆34Updated 5 months ago
• inclusionAI / Ming
  Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.
  ☆481Updated last month
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆31Updated last month
• CASIA-LM / OpenS2S
  OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model
  ☆89Updated 3 months ago
• OmniMMI / OmniMMI
  [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts
  ☆19Updated 6 months ago
• SpeechEE / SpeechEE
  ☆11Updated 2 months ago
• 0nutation / SpeechAgents
  SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems
  ☆84Updated last year
• HumanMLLM / ViSpeak
  (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"
  ☆40Updated 3 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆30Updated 10 months ago