Alternatives and similar repositories for Sound2Scene

Users that are interested in Sound2Scene are comparing it to the libraries listed below

• BurakCanBiner / SonicDiffusion
  ☆41Updated last year
• lzhangbj / ASVA
  [ECCV 2024 Oral] Audio-Synchronized Visual Animation
  ☆58Updated last year
• ku-vai / TPoS
  This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)
  ☆25Updated 2 years ago
• yzxing87 / Seeing-and-Hearing
  [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ☆154Updated last year
• WikiChao / DAVIS
  [🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound …
  ☆25Updated 2 months ago
• Tinglok / avstyle
  Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)
  ☆15Updated 2 years ago
• kaist-ami / SoundBrush
  ☆10Updated 3 weeks ago
• schowdhury671 / melfusion
  ☆58Updated last year
• x360dataset / x360dataset-kit
  ☆32Updated 5 months ago
• rxtan2 / AVSeT
  ☆17Updated 2 years ago
• aspirinone / CATR.github.io
  ☆31Updated last year
• lyndonzheng / CVQ-VAE
  [ICCV 2023] Online Clustered Codebook
  ☆181Updated last year
• Sindhu-Hegde / jegal
  Official code for the paper "Understanding Co-speech Gestures in-the-wild"
  ☆20Updated 2 months ago
• litwellchi / MMTrail
  [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  ☆33Updated 10 months ago
• Neur-IO / OptVQ
  Towards training VQ-VAE models robustly!
  ☆91Updated 5 months ago
• liangsusan-git / AV-NeRF
  [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
  ☆32Updated last year
• cvlab-kaist / DirecT2V
  ☆80Updated 2 years ago
• Jyxarthur / shot-by-shot
  [ICCV 2025] Official Implementation of "Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generation". Junyu Xie, Tengda H…
  ☆20Updated 5 months ago
• IFICL / SLfM
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆41Updated 2 years ago
• Minglu58 / TA2V
  ☆15Updated last month
• scofield7419 / Dysen
  CVPR 24 paper: Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMs
  ☆14Updated last year
• SooLab / Free-Bloom
  [NeurIPS 2023] Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator
  ☆97Updated last year
• kaist-ami / SMILE-Dataset
  [NAACL'24] Repository for "SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models"
  ☆15Updated last year
• shim0114 / SSM-Meets-Video-Diffusion-Models
  ☆48Updated 9 months ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆25Updated last year
• SAGNIKMJR / ego-AV-spatial-correspondence
  [CVPR 2024] Code and datasets for 'Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos'
  ☆12Updated last year
• PardoAlejo / MatchDiffusion
  ☆20Updated 7 months ago
• npurson / fid-metrics
  A toolkit for computing Fréchet Inception Distance (FID) & Fréchet Video Distance (FVD) metrics.
  ☆40Updated 7 months ago
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆200Updated last year
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆87Updated last year