Alternatives and similar repositories for Seeing-and-Hearing

Users that are interested in Seeing-and-Hearing are comparing it to the libraries listed below

• HUIZ-A / SVA

  View on GitHub
  ☆20Apr 26, 2024Updated last year
• luosiallen / Diff-Foley

  View on GitHub
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆200May 29, 2024Updated last year
• ariesssxu / vta-ldm

  View on GitHub
  ☆62Jun 15, 2025Updated 8 months ago
• ilpoviertola / V-AURA

  View on GitHub
  The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)
  ☆32Updated this week
• naver-ai / rewas

  View on GitHub
  Official PyTorch implementation of ReWaS (AAAI'25) "Read, Watch and Scream! Sound Generation from Text and Video"
  ☆43Dec 13, 2024Updated last year
• v-iashin / Synchformer

  View on GitHub
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆107Sep 15, 2025Updated 5 months ago
• PolyPerceiver-Lab / STAV2A

  View on GitHub
  ☆19Aug 11, 2025Updated 6 months ago
• ku-vai / TPoS

  View on GitHub
  This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)
  ☆25Dec 7, 2023Updated 2 years ago
• guyyariv / TempoTokens

  View on GitHub
  This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptati…
  ☆129Feb 13, 2025Updated last year
• cyanbx / Frieren-V2A

  View on GitHub
  Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)
  ☆59Apr 3, 2025Updated 10 months ago
• heng-hw / V2A-Mapper

  View on GitHub
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆27Dec 14, 2023Updated 2 years ago
• kaist-ami / Sound2Scene

  View on GitHub
  ☆40Apr 14, 2025Updated 10 months ago
• StelaBou / Diffusion-Act

  View on GitHub
  ☆24Sep 5, 2025Updated 5 months ago
• OpenNLPLab / TAVGBench

  View on GitHub
  Demo page of TAVGBench: Benchmarking Text to Audible-Video Generation
  ☆14Apr 7, 2025Updated 10 months ago
• guyyariv / AudioToken

  View on GitHub
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆88Jun 18, 2024Updated last year
• happylittlecat2333 / Auffusion

  View on GitHub
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆193Mar 25, 2024Updated last year
• XYPB / CondFoleyGen

  View on GitHub
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆93Dec 8, 2023Updated 2 years ago
• open-mmlab / FoleyCrafter

  View on GitHub
  [IJCV] FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds. AI拟音大师，给你的无声视频添加生动而且同步的音效 😝
  ☆644Jul 26, 2024Updated last year
• kaist-ami / SoundBrush

  View on GitHub
  ☆10Dec 8, 2025Updated 2 months ago
• researchmm / MM-Diffusion

  View on GitHub
  [CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  ☆451Jun 5, 2024Updated last year
• BurakCanBiner / SonicDiffusion

  View on GitHub
  ☆42Nov 8, 2024Updated last year
• yannqi / Draw-an-Audio-Code

  View on GitHub
  Official code of the paper: Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis.
  ☆45Sep 11, 2024Updated last year
• arthur-qiu / FreeNoise-LaVie

  View on GitHub
  [ICLR 2024] Code for FreeNoise based on LaVie
  ☆34Jan 28, 2024Updated 2 years ago
• IFICL / SLfM

  View on GitHub
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆41Dec 23, 2023Updated 2 years ago
• camenduru / FoleyCrafter-jupyter

  View on GitHub
  ☆11Jun 28, 2024Updated last year
• stoneMo / OneAVM

  View on GitHub
  Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)
  ☆12Jun 1, 2023Updated 2 years ago
• hche11 / VGGSound

  View on GitHub
  VGGSound: A Large-scale Audio-Visual Dataset
  ☆350Sep 13, 2021Updated 4 years ago
• VideoVerses / VideoTuna

  View on GitHub
  Let's finetune video generation models!
  ☆539Sep 15, 2025Updated 5 months ago
• JunjieYang97 / Meta-ControlNet

  View on GitHub
  ☆31Jan 7, 2024Updated 2 years ago
• ZeyueT / VidMuse

  View on GitHub
  ☆115Jun 7, 2025Updated 8 months ago
• v-iashin / SparseSync

  View on GitHub
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆54Jan 29, 2024Updated 2 years ago
• Xiaohao-Liu / Awesome-Vison2Audio

  View on GitHub
  A curated list of Vision (video/image) to Audio Generation
  ☆98Feb 10, 2026Updated last week
• YoonjinXD / T-FOLEY

  View on GitHub
  Implementation of the paper, T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis, ac…
  ☆34May 25, 2024Updated last year
• kuai-lab / soundini-official

  View on GitHub
  We are committing code.
  ☆44May 18, 2023Updated 2 years ago
• roger-tseng / av-superb

  View on GitHub
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆58Apr 17, 2024Updated last year
• YingqingHe / Awesome-LLMs-meet-Multimodal-Generation

  View on GitHub
  🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
  ☆540Apr 4, 2025Updated 10 months ago
• victor-rong / video-generation-study

  View on GitHub
  ☆16Nov 28, 2023Updated 2 years ago
• SMILE-data / SMILE

  View on GitHub
  SMILE: A Multimodal Dataset for Understanding Laughter
  ☆13Jun 15, 2023Updated 2 years ago
• showlab / T2VScore

  View on GitHub
  T2VScore: Towards A Better Metric for Text-to-Video Generation
  ☆80Apr 10, 2024Updated last year