Alternatives and similar repositories for InteractiveOmni

Users that are interested in InteractiveOmni are comparing it to the libraries listed below

• yzxing87 / Seeing-and-Hearing
  [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ☆155Updated last year
• klingfoley / Kling-Foley
  Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
  ☆63Updated 7 months ago
• lzhangbj / ASVA
  [ECCV 2024 Oral] Audio-Synchronized Visual Animation
  ☆57Updated last year
• InternLM / StarBench
  ☆38Updated 3 weeks ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆200Updated last year
• ariesssxu / vta-ldm
  ☆62Updated 7 months ago
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆76Updated 10 months ago
• ZeyueT / VidMuse
  ☆114Updated 8 months ago
• litwellchi / MMTrail
  [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  ☆33Updated last year
• RainBowLuoCS / OpenOmni
  (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…
  ☆124Updated 3 months ago
• Xiaohao-Liu / Awesome-Vison2Audio
  A curated list of Vision (video/image) to Audio Generation
  ☆98Updated 2 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆27Updated 2 years ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆106Updated 4 months ago
• youngsheen / SimVQ
  [ICCV 2025] SimVQ: Addressing Representation Collapse in Vector Quantized Models with One Linear Layer
  ☆316Updated last year
• inclusionAI / Ming
  Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.
  ☆580Updated 3 months ago
• zh460045050 / VQGAN-LC
  ☆141Updated last year
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆118Updated 8 months ago
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆86Updated last month
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆72Updated last year
• Hannieliao / Baton
  Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"
  ☆32Updated 11 months ago
• 0nutation / Lookup-Free-Quantization
  ☆31Updated 2 years ago
• naver-ai / rewas
  Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"
  ☆43Updated last year
• HarryHsing / EchoInk
  EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…
  ☆73Updated 8 months ago
• X-LANCE / VQTalker
  [AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
  ☆53Updated last year
• snap-research / GenAU
  ☆49Updated 9 months ago
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆93Updated 2 years ago
• ku-vai / TPoS
  This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)
  ☆25Updated 2 years ago
• feizc / DiT-MoE
  Scaling Diffusion Transformers with Mixture of Experts
  ☆415Updated last year
• luping-liu / LongAlign
  The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)
  ☆80Updated 9 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆88Updated last year