Alternatives and similar repositories for novel-view-acoustic-synthesis

Users that are interested in novel-view-acoustic-synthesis are comparing it to the libraries listed below

• samuel-clarke / RealImpact
  ☆33Updated 2 years ago
• sukun1045 / video-physics-sound-diffusion
  ☆48Updated last year
• facebookresearch / replay_dataset
  Download scripts and tools for Replay dataset.
  ☆36Updated 2 years ago
• SheldonTsui / PseudoBinaural_CVPR2021
  Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)
  ☆69Updated 4 years ago
• IFICL / SLfM
  Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
  ☆41Updated 2 years ago
• facebookresearch / SoundingBodies
  We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.
  ☆89Updated last year
• facebookresearch / facestar
  Facestar dataset. High quality audio-visual recordings of human conversational speech.
  ☆110Updated 3 years ago
• apple / ml-nvas3d
  ☆48Updated last year
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆40Updated 2 years ago
• AmandineBtto / NeRAF
  [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
  ☆32Updated 8 months ago
• ChanganVR / action2sound
  Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
  ☆25Updated last year
• Surrey-UP-Lab / AV-GS
  AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
  ☆12Updated last year
• xrenaa / Retriever
  [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"
  ☆54Updated 3 years ago
• mhamilton723 / DenseAV
  Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
  ☆86Updated last year
• XYPB / CondFoleyGen
  Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".
  ☆93Updated 2 years ago
• aluo-x / Learning_Neural_Acoustic_Fields
  Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)
  ☆159Updated 2 years ago
• facebookresearch / visual-acoustic-matching
  Repo for Visual Acoustic Matching, CVPR 2022
  ☆70Updated 2 years ago
• guyyariv / AudioToken
  This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …
  ☆88Updated last year
• showlab / AVA-AVD
  ☆21Updated 3 years ago
• atosystem / SpeechCLIP
  SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022
  ☆118Updated 3 years ago
• lucidrains / rvq-vae-gpt
  My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation
  ☆90Updated last year
• OpenGVLab / LORIS
  [ICML2023] Long-Term Rhythmic Video Soundtracker
  ☆61Updated 6 months ago
• KranthiKumarR / Localize-to-Binauralize
  Localize to Binauralize: Audio Spatialization from Visual Sound Source Localization (ICCV 2021)
  ☆10Updated 4 years ago
• patil-suraj / simple-diffusion
  An implementation of simple diffusion in PyTorch (and JAX)
  ☆35Updated 3 years ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆104Updated 4 months ago
• ZiqiaoPeng / SelfTalk
  Code for "SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces" ACM MM 2023
  ☆30Updated 2 years ago
• zcxu-eric / Ego4d_TalkNet_ASD
  ☆21Updated 3 years ago
• SAGNIKMJR / few-shot-rir
  Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)
  ☆23Updated 2 years ago
• lucidrains / NWT-pytorch
  Implementation of NWT, audio-to-video generation, in Pytorch
  ☆92Updated 3 years ago
• snap-research / GenAU
  ☆47Updated 9 months ago