Alternatives and similar repositories for novel-view-acoustic-synthesis

Users that are interested in novel-view-acoustic-synthesis are comparing it to the libraries listed below

• IFICL / SLfM
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆40Updated last year
• facebookresearch / replay_dataset
  Download scripts and tools for Replay dataset.
  ☆35Updated 2 years ago
• samuel-clarke / RealImpact
  ☆29Updated 2 years ago
• SheldonTsui / PseudoBinaural_CVPR2021
  Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)
  ☆65Updated 4 years ago
• sukun1045 / video-physics-sound-diffusion
  ☆46Updated last year
• apple / ml-nvas3d
  ☆47Updated last year
• Surrey-UP-Lab / AV-GS
  AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
  ☆11Updated 10 months ago
• facebookresearch / SoundingBodies
  We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.
  ☆88Updated last year
• AmandineBtto / NeRAF
  [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
  ☆28Updated 3 months ago
• xrenaa / Retriever
  [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"
  ☆54Updated 2 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆85Updated last year
• showlab / AVA-AVD
  ☆18Updated 2 years ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆23Updated 11 months ago
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆109Updated 3 years ago
• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆83Updated last year
• KranthiKumarR / Localize-to-Binauralize
  Localize to Binauralize: Audio Spatialization from Visual Sound Source Localization (ICCV 2021)
  ☆10Updated 3 years ago
• OpenGVLab / LORIS
  [ICML2023] Long-Term Rhythmic Video Soundtracker
  ☆61Updated last month
• patil-suraj / simple-diffusion
  An implementation of simple diffusion in PyTorch (and JAX)
  ☆35Updated 2 years ago
• aluo-x / Learning_Neural_Acoustic_Fields
  Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)
  ☆150Updated last year
• schowdhury671 / melfusion
  ☆56Updated 10 months ago
• Neur-IO / OptVQ
  Towards training VQ-VAE models robustly!
  ☆82Updated last month
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆88Updated last year
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated last year
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆68Updated 2 years ago
• Tinglok / avstyle
  Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)
  ☆15Updated 2 years ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆51Updated last year
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆116Updated 2 years ago
• lucidrains / NWT-pytorch
  Implementation of NWT, audio-to-video generation, in Pytorch
  ☆91Updated 3 years ago
• maswang32 / hearinganythinganywhere
  Hearing Anything Anywhere Code Release
  ☆45Updated last year
• lyndonzheng / CVQ-VAE
  [ICCV 2023] Online Clustered Codebook
  ☆176Updated 11 months ago