Alternatives and similar repositories for novel-view-acoustic-synthesis

Users that are interested in novel-view-acoustic-synthesis are comparing it to the libraries listed below

• IFICL / SLfM
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆41Updated last year
• facebookresearch / replay_dataset
  Download scripts and tools for Replay dataset.
  ☆36Updated 2 years ago
• facebookresearch / SoundingBodies
  We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.
  ☆88Updated last year
• samuel-clarke / RealImpact
  ☆31Updated 2 years ago
• SheldonTsui / PseudoBinaural_CVPR2021
  Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)
  ☆68Updated 4 years ago
• sukun1045 / video-physics-sound-diffusion
  ☆47Updated last year
• apple / ml-nvas3d
  ☆48Updated last year
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆110Updated 3 years ago
• AmandineBtto / NeRAF
  [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
  ☆32Updated 6 months ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated 2 years ago
• Surrey-UP-Lab / AV-GS
  AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
  ☆12Updated last year
• OpenGVLab / LORIS
  [ICML2023] Long-Term Rhythmic Video Soundtracker
  ☆61Updated 4 months ago
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆91Updated 2 years ago
• aluo-x / Learning_Neural_Acoustic_Fields
  Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)
  ☆155Updated last year
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆25Updated last year
• xrenaa / Retriever
  [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"
  ☆54Updated 3 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆87Updated last year
• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆85Updated last year
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆70Updated 2 years ago
• KranthiKumarR / Localize-to-Binauralize
  Localize to Binauralize: Audio Spatialization from Visual Sound Source Localization (ICCV 2021)
  ☆10Updated 4 years ago
• showlab / AVA-AVD
  ☆20Updated 3 years ago
• maswang32 / hearinganythinganywhere
  Hearing Anything Anywhere Code Release
  ☆49Updated last month
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆53Updated last year
• patil-suraj / simple-diffusion
  An implementation of simple diffusion in PyTorch (and JAX)
  ☆35Updated 2 years ago
• SAGNIKMJR / few-shot-rir
  Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)
  ☆23Updated 2 years ago
• chuangg / Foley-Music
  PyTorch implementation of ECCV 2020 paper "Foley Music: Learning to Generate Music from Videos "
  ☆40Updated 4 years ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆97Updated 2 months ago
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆117Updated 3 years ago
• epic-kitchens / epic-sounds-annotations
  Splits for epic-sounds dataset
  ☆83Updated 4 months ago
• schowdhury671 / melfusion
  ☆58Updated last year