Alternatives and similar repositories for Seeing-and-Hearing

Users that are interested in Seeing-and-Hearing are comparing it to the libraries listed below

• lzhangbj / ASVA
  [ECCV 2024 Oral] Audio-Synchronized Visual Animation
  ☆54Updated 11 months ago
• BurakCanBiner / SonicDiffusion
  ☆35Updated 9 months ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆195Updated last year
• litwellchi / MMTrail
  [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  ☆31Updated 6 months ago
• schowdhury671 / melfusion
  ☆56Updated 10 months ago
• klingfoley / Kling-Foley
  Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
  ☆58Updated 2 months ago
• ku-vai / TPoS
  This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)
  ☆23Updated last year
• ZeyueT / VidMuse
  ☆88Updated 2 months ago
• kaist-ami / Sound2Scene
  ☆36Updated 4 months ago
• Minglu58 / TA2V
  ☆16Updated 8 months ago
• ariesssxu / vta-ldm
  ☆60Updated 2 months ago
• X-LANCE / VQTalker
  [AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
  ☆50Updated 8 months ago
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆88Updated last year
• JingyuanYY / EmoGen
  This is the official implementation of 2024 CVPR paper "EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models".
  ☆87Updated 7 months ago
• AILab-CVC / CV-VAE
  [NeurIPS 2024] CV-VAE: A Compatible Video VAE for Latent Generative Video Models
  ☆278Updated 8 months ago
• TIGER-AI-Lab / ConsistI2V
  ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation [TMLR 2024]
  ☆250Updated last year
• npurson / fid-metrics
  A toolkit for computing Fréchet Inception Distance (FID) & Fréchet Video Distance (FVD) metrics.
  ☆36Updated 3 months ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆85Updated last year
• researchmm / MM-Diffusion
  [CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  ☆440Updated last year
• GalaxyCong / EmoDubber
  Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.
  ☆27Updated 2 months ago
• sizhelee / Diff-BGM
  official code for CVPR'24 paper Diff-BGM
  ☆68Updated 10 months ago
• zh460045050 / VQGAN-LC
  ☆135Updated last year
• jacklishufan / OmniFlows
  The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
  ☆84Updated 2 weeks ago
• TonyLianLong / LLM-groundedVideoDiffusion
  [ICLR 2024] LLM-grounded Video Diffusion Models (LVD): official implementation for the LVD paper
  ☆156Updated last year
• YuqingWang1029 / TokenBridge
  [ICCV2025] TokenBridge: Bridging Continuous and Discrete Tokens for Autoregressive Visual Generation. https://yuqingwang1029.github.io/To…
  ☆134Updated last month
• guyyariv / TempoTokens
  This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptati…
  ☆125Updated 6 months ago
• zhuole1025 / SymMV
  [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation
  ☆77Updated last year
• jacklishufan / InstructAny2Pix
  PyTorch implementation of InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction Following
  ☆30Updated 7 months ago
• luping-liu / LongAlign
  The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)
  ☆79Updated 4 months ago
• OpenNLPLab / TAVGBench
  Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation
  ☆13Updated 4 months ago