Alternatives and similar repositories for novel-view-acoustic-synthesis

Users that are interested in novel-view-acoustic-synthesis are comparing it to the libraries listed below

• IFICL / SLfM
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆40Updated last year
• samuel-clarke / RealImpact
  ☆29Updated 2 years ago
• sukun1045 / video-physics-sound-diffusion
  ☆47Updated last year
• SheldonTsui / PseudoBinaural_CVPR2021
  Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)
  ☆65Updated 4 years ago
• facebookresearch / replay_dataset
  Download scripts and tools for Replay dataset.
  ☆35Updated 2 years ago
• facebookresearch / SoundingBodies
  We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.
  ☆88Updated last year
• apple / ml-nvas3d
  ☆47Updated last year
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆110Updated 3 years ago
• AmandineBtto / NeRAF
  [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
  ☆29Updated 4 months ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated 2 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆85Updated last year
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆24Updated last year
• Surrey-UP-Lab / AV-GS
  AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
  ☆12Updated last year
• KranthiKumarR / Localize-to-Binauralize
  Localize to Binauralize: Audio Spatialization from Visual Sound Source Localization (ICCV 2021)
  ☆10Updated 4 years ago
• xrenaa / Retriever
  [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"
  ☆54Updated 2 years ago
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆90Updated last year
• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆83Updated last year
• OpenGVLab / LORIS
  [ICML2023] Long-Term Rhythmic Video Soundtracker
  ☆60Updated 2 months ago
• aluo-x / Learning_Neural_Acoustic_Fields
  Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)
  ☆150Updated last year
• showlab / AVA-AVD
  ☆19Updated 2 years ago
• v-iashin / SparseSync
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆53Updated last year
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆68Updated 2 years ago
• penn-waves-lab / AVR
  [Neurips'24 Spotlight] Official code for "Acoustic Volume Rendering for Neural Impulse Response Fields"
  ☆43Updated 9 months ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆90Updated 3 weeks ago
• Tinglok / avstyle
  Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)
  ☆15Updated 2 years ago
• snap-research / GenAU
  ☆41Updated 6 months ago
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆116Updated 2 years ago
• liangsusan-git / AV-NeRF
  [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
  ☆30Updated last year
• cvlab-columbia / voicecamo
  Code for the paper Real-Time Neural Voice Camouflage
  ☆28Updated 3 years ago
• schowdhury671 / melfusion
  ☆58Updated last year