[NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
☆35Feb 15, 2024Updated 2 years ago
Alternatives and similar repositories for AV-NeRF
Users that are interested in AV-NeRF are comparing it to the libraries listed below
Sorting:
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆41Sep 10, 2025Updated 6 months ago
- [🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound …☆28Nov 1, 2025Updated 4 months ago
- [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.☆33Mar 11, 2026Updated last week
- Hearing Anything Anywhere Code Release☆49Nov 11, 2025Updated 4 months ago
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆61Aug 29, 2024Updated last year
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)☆164Jan 20, 2024Updated 2 years ago
- AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis☆12Oct 3, 2024Updated last year
- [CVPR 2025 GMCV] Test-Time Frequency Scaling: Instant Frequency Control for Any Diffusion Model☆55May 31, 2025Updated 9 months ago
- ☆24Nov 1, 2024Updated last year
- ☆20May 11, 2025Updated 10 months ago
- [AAAI 2025] Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding☆34Mar 21, 2025Updated last year
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆23Nov 20, 2023Updated 2 years ago
- The repository provides code for EgoMAN model and dataset creation scripts.☆28Dec 31, 2025Updated 2 months ago
- An open-source application for 3D acoustic simulation☆44Updated this week
- [ECCV 2024 Oral] Audio-Synchronized Visual Animation☆60Mar 15, 2026Updated last week
- Download scripts and tools for Replay dataset.☆36Jun 23, 2023Updated 2 years ago
- ☆12Nov 1, 2024Updated last year
- Semantic Object Prediction and Spatial Sound Super-Resolution with Binaural Sounds☆20Dec 18, 2021Updated 4 years ago
- [Arxiv'25] DINO-Tok: Adapting DINO for Visual Tokenizers☆35Nov 25, 2025Updated 3 months ago
- Code for Deep Multimodal Clustering for Unsupervised Audiovisual Learning (CVPR2019)☆15May 27, 2020Updated 5 years ago
- Spatial Audio Generation☆117Mar 24, 2023Updated 2 years ago
- Code for paper Learning Audio-Visual Dereverberation☆31Aug 10, 2022Updated 3 years ago
- [NeurIPS'24 splotlight] Official Repo for AcoustiX used in Acoustic volume rendering for neural impulse response fields.☆37Dec 15, 2025Updated 3 months ago
- Code for learning SLAMBOOK☆10Aug 4, 2018Updated 7 years ago
- We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.☆90May 29, 2024Updated last year
- ☆24Jul 15, 2024Updated last year
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆60Jul 2, 2025Updated 8 months ago
- Code and model for paper <Mutual Information Maximization for Effective Lip Reading>☆19Sep 4, 2020Updated 5 years ago
- ☆117Feb 26, 2026Updated 3 weeks ago
- ☆14Jun 2, 2025Updated 9 months ago
- ☆33Apr 10, 2023Updated 2 years ago
- Event Relation in Text-to-Audio (TTA) Generation☆20Feb 26, 2025Updated last year
- Open repository of simulated Room Impulse Responses (RIR) accompanying the paper "Hearing Anywhere in Any Environment"☆71Aug 11, 2025Updated 7 months ago
- A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple task…☆447Sep 29, 2023Updated 2 years ago
- The LAP Challenge aims at advancing spatial audio technologies through the personalization of HRTFs.☆16Aug 12, 2025Updated 7 months ago
- This implementation is based on the SincAlignNet model from the paper 'Frequency-Based Alignment of EEG and Audio Signals Using Contrasti…☆14Jul 28, 2025Updated 7 months ago
- Official Implementation of the Paper:Motion-example-controlled Co-speech Gesture Generation Leveraging Large Language Models (Siggraph 20…☆25Dec 18, 2025Updated 3 months ago
- Multi-band Frequency Reconstruction for Neural Psychoacoustic Coding☆19May 5, 2025Updated 10 months ago
- ☆13Jul 14, 2024Updated last year