Alternatives and similar repositories for Sound2Scene

Users that are interested in Sound2Scene are comparing it to the libraries listed below

• BurakCanBiner / SonicDiffusion
  ☆41Updated last year
• lzhangbj / ASVA
  [ECCV 2024 Oral] Audio-Synchronized Visual Animation
  ☆57Updated last year
• yzxing87 / Seeing-and-Hearing
  [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ☆155Updated last year
• ku-vai / TPoS
  This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)
  ☆25Updated 2 years ago
• schowdhury671 / melfusion
  ☆58Updated last year
• Tinglok / avstyle
  Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)
  ☆15Updated 2 years ago
• kaist-ami / SoundBrush
  ☆10Updated last month
• WikiChao / DAVIS
  [🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound …
  ☆25Updated 2 months ago
• x360dataset / x360dataset-kit
  ☆33Updated 6 months ago
• kaist-ami / SMILE-Dataset
  [NAACL'24] Repository for "SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models"
  ☆15Updated last year
• lyndonzheng / CVQ-VAE
  [ICCV 2023] Online Clustered Codebook
  ☆181Updated last year
• scofield7419 / Dysen
  CVPR 24 paper: Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMs
  ☆14Updated last year
• Minglu58 / TA2V
  ☆15Updated last month
• Sindhu-Hegde / jegal
  Official code for the paper "Understanding Co-speech Gestures in-the-wild"
  ☆20Updated 2 months ago
• shim0114 / SSM-Meets-Video-Diffusion-Models
  ☆48Updated 9 months ago
• Neur-IO / OptVQ
  Towards training VQ-VAE models robustly!
  ☆91Updated 5 months ago
• npurson / fid-metrics
  A toolkit for computing Fréchet Inception Distance (FID) & Fréchet Video Distance (FVD) metrics.
  ☆41Updated 7 months ago
• aspirinone / CATR.github.io
  ☆31Updated last year
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆200Updated last year
• JingyuanYY / EmoGen
  This is the official implementation of 2024 CVPR paper "EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models".
  ☆91Updated 2 months ago
• rxtan2 / AVSeT
  ☆17Updated 2 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆87Updated last year
• Jyxarthur / shot-by-shot
  [ICCV 2025] Official Implementation of "Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generation". Junyu Xie, Tengda H…
  ☆20Updated 5 months ago
• HyelinNAM / ContrastiveDenoisingScore
  [CVPR2024] Official PyTorch implementation of "Contrastive Denoising Score(CDS) for Text-guided Latent Diffusion Image Editing"
  ☆119Updated last year
• researchmm / MM-Diffusion
  [CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  ☆450Updated last year
• litwellchi / MMTrail
  [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  ☆33Updated 11 months ago
• TonyLianLong / LLM-groundedVideoDiffusion
  [ICLR 2024] LLM-grounded Video Diffusion Models (LVD): official implementation for the LVD paper
  ☆163Updated last year
• liangsusan-git / AV-NeRF
  [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
  ☆33Updated last year
• jacklishufan / InstructAny2Pix
  PyTorch implementation of InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction Following
  ☆30Updated 11 months ago
• SooLab / Free-Bloom
  [NeurIPS 2023] Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator
  ☆97Updated last year