Alternatives and similar repositories for novel-view-acoustic-synthesis:

Users that are interested in novel-view-acoustic-synthesis are comparing it to the libraries listed below

• facebookresearch / replay_dataset
  Download scripts and tools for Replay dataset.
  ☆32Updated last year
• IFICL / SLfM
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆37Updated last year
• samuel-clarke / RealImpact
  ☆24Updated 2 years ago
• AmandineBtto / NeRAF
  [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
  ☆19Updated 2 weeks ago
• Surrey-UP-Lab / AV-GS
  AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
  ☆10Updated 6 months ago
• Tinglok / avstyle
  Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)
  ☆15Updated 2 years ago
• facebookresearch / SoundingBodies
  We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.
  ☆84Updated 10 months ago
• apple / ml-nvas3d
  ☆47Updated 9 months ago
• snap-research / GenAU
  ☆29Updated last week
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆86Updated last year
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆39Updated last year
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆21Updated 6 months ago
• SheldonTsui / PseudoBinaural_CVPR2021
  Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)
  ☆65Updated 3 years ago
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆106Updated 3 years ago
• KranthiKumarR / Localize-to-Binauralize
  Localize to Binauralize: Audio Spatialization from Visual Sound Source Localization (ICCV 2021)
  ☆10Updated 3 years ago
• xrenaa / Retriever
  [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"
  ☆54Updated 2 years ago
• sukun1045 / video-physics-sound-diffusion
  ☆45Updated 9 months ago
• Lakonik / GMFlow
  Gaussian Mixture Flow Matching Models (GMFlow)
  ☆80Updated this week
• orig333 / Blended-NeRF
  ☆23Updated last year
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆67Updated 2 years ago
• ZiqiaoPeng / SelfTalk
  Code for "SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces" ACM MM 2023
  ☆30Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆58Updated 2 months ago
• showlab / AVA-AVD
  ☆16Updated 2 years ago
• facebookresearch / real-acoustic-fields
  Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark
  ☆47Updated 7 months ago
• OpenGVLab / LORIS
  Long-Term Rhythmic Video Soundtracker, ICML2023
  ☆58Updated 9 months ago
• penn-waves-lab / AVR
  [Neurips'24 Spotlight] Official code for "Acoustic Volume Rendering for Neural Impulse Response Fields"
  ☆34Updated 3 months ago
• lucidrains / NWT-pytorch
  Implementation of NWT, audio-to-video generation, in Pytorch
  ☆90Updated 3 years ago
• Ugness / MeBT
  official implementation of the paper: Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transform…
  ☆29Updated last year
• liangsusan-git / AV-NeRF
  [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
  ☆27Updated last year
• kaist-ami / Sound2Scene
  ☆33Updated last week