Alternatives and similar repositories for InteractiveOmni

Users that are interested in InteractiveOmni are comparing it to the libraries listed below

• klingfoley / Kling-Foley
  Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
  ☆61Updated 5 months ago
• ariesssxu / vta-ldm
  ☆62Updated 5 months ago
• lzhangbj / ASVA
  [ECCV 2024 Oral] Audio-Synchronized Visual Animation
  ☆58Updated last year
• yzxing87 / Seeing-and-Hearing
  [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ☆152Updated last year
• ZeyueT / VidMuse
  ☆105Updated 5 months ago
• X-LANCE / VQTalker
  [AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
  ☆52Updated 11 months ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆198Updated last year
• InternLM / StarBench
  ☆33Updated last month
• GalaxyCong / EmoDubber
  Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.
  ☆31Updated 6 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆26Updated last year
• Text-to-Audio / Make-An-Audio-3
  Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers
  ☆113Updated 6 months ago
• FreedomIntelligence / TalkVid
  TalkVid: A Large-Scale Diversified Dataset for Audio-Driven Talking Head Synthesis
  ☆117Updated 2 weeks ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆71Updated last year
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆87Updated last year
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆91Updated last year
• Moon0316 / T2A
  Project page for "Improving Few-shot Learning for Talking Face System with TTS Data Augmentation" for ICASSP2023
  ☆86Updated 2 years ago
• DavidMChan / Anim400K
  Anim-400K: A dataset designed from the ground up for automated dubbing of video
  ☆110Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆95Updated 2 months ago
• HumanMLLM / CoGenAV
  ☆61Updated 5 months ago
• yl4467 / singer
  ☆14Updated 9 months ago
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆84Updated 2 months ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆179Updated last year
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆74Updated 8 months ago
• RainBowLuoCS / OpenOmni
  (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…
  ☆112Updated 3 weeks ago
• snap-research / GenAU
  ☆43Updated 7 months ago
• litwellchi / MMTrail
  [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  ☆33Updated 9 months ago
• GiantAILab / YingMusic-Singer
  ☆25Updated this week
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆190Updated last year
• guyyariv / TempoTokens
  This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptati…
  ☆128Updated 9 months ago
• ku-vai / TPoS
  This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)
  ☆25Updated last year