[NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
☆35Feb 15, 2024Updated 2 years ago
Alternatives and similar repositories for AV-NeRF
Users that are interested in AV-NeRF are comparing it to the libraries listed below
Sorting:
- [🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound …☆28Nov 1, 2025Updated 4 months ago
- [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.☆33Feb 6, 2026Updated 3 weeks ago
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆41Sep 10, 2025Updated 5 months ago
- Hearing Anything Anywhere Code Release☆49Nov 11, 2025Updated 3 months ago
- AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis☆12Oct 3, 2024Updated last year
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆60Aug 29, 2024Updated last year
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)☆162Jan 20, 2024Updated 2 years ago
- ☆24Nov 1, 2024Updated last year
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆23Nov 20, 2023Updated 2 years ago
- [AAAI 2025] Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding☆34Mar 21, 2025Updated 11 months ago
- [CVPR 2025] VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?☆29May 10, 2025Updated 9 months ago
- [CVPR 2025 GMCV] Test-Time Frequency Scaling: Instant Frequency Control for Any Diffusion Model☆55May 31, 2025Updated 9 months ago
- ☆13Aug 13, 2023Updated 2 years ago
- The repository provides code for EgoMAN model and dataset creation scripts.☆27Dec 31, 2025Updated 2 months ago
- [ECCV 2024 Oral] Audio-Synchronized Visual Animation☆57Sep 12, 2024Updated last year
- ☆12Nov 1, 2024Updated last year
- [CVPR 2025] Pytorch implementation of the paper "Hearing Anywhere in Any Environment"☆25Sep 18, 2025Updated 5 months ago
- Code for Deep Multimodal Clustering for Unsupervised Audiovisual Learning (CVPR2019)☆15May 27, 2020Updated 5 years ago
- The implementation of g2pL with a new open dataset.☆16May 14, 2023Updated 2 years ago
- An open-source Python GUI for 3D acoustic simulations☆42Updated this week
- Semantic Object Prediction and Spatial Sound Super-Resolution with Binaural Sounds☆20Dec 18, 2021Updated 4 years ago
- ☆24Jul 15, 2024Updated last year
- [Arxiv'25] DINO-Tok: Adapting DINO for Visual Tokenizers☆35Nov 25, 2025Updated 3 months ago
- This dataset is presented in the paper Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video…☆12Sep 21, 2022Updated 3 years ago
- Spatial Audio Generation☆117Mar 24, 2023Updated 2 years ago
- Code and model for paper <Mutual Information Maximization for Effective Lip Reading>☆19Sep 4, 2020Updated 5 years ago
- Diffusion generation on Mesh toolbox☆23Feb 10, 2025Updated last year
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆60Jul 2, 2025Updated 8 months ago
- [Neurips'24 and 25] "Acoustic Volume Rendering for Neural Impulse Response Fields" and "Resounding Acoustic Fields With Reciprocity"☆79Dec 18, 2025Updated 2 months ago
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆26Jan 6, 2024Updated 2 years ago
- Code for paper Learning Audio-Visual Dereverberation☆30Aug 10, 2022Updated 3 years ago
- ☆33Apr 10, 2023Updated 2 years ago
- [NeurIPS'24 splotlight] Official Repo for AcoustiX used in Acoustic volume rendering for neural impulse response fields.☆37Dec 15, 2025Updated 2 months ago
- Source code for 2021 ICCV paper "In-the-Wild Single Camera 3D Reconstruction Through Moving Water Surfaces"☆37Sep 18, 2021Updated 4 years ago
- ☆29Jun 15, 2022Updated 3 years ago
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆34Feb 21, 2025Updated last year
- A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple task…☆440Sep 29, 2023Updated 2 years ago
- ☆30Jun 14, 2022Updated 3 years ago
- This implementation is based on the SincAlignNet model from the paper 'Frequency-Based Alignment of EEG and Audio Signals Using Contrasti…☆14Jul 28, 2025Updated 7 months ago