[NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
☆36Feb 15, 2024Updated 2 years ago
Alternatives and similar repositories for AV-NeRF
Users that are interested in AV-NeRF are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆46Sep 10, 2025Updated 9 months ago
- [🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound …☆32Mar 30, 2026Updated 2 months ago
- [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.☆36Mar 11, 2026Updated 2 months ago
- Hearing Anything Anywhere Code Release☆52Nov 11, 2025Updated 6 months ago
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆62Aug 29, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)☆166Jan 20, 2024Updated 2 years ago
- AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis☆12Oct 3, 2024Updated last year
- [CVPR 2025 GMCV] Test-Time Frequency Scaling: Instant Frequency Control for Any Diffusion Model☆55May 31, 2025Updated last year
- ☆24Nov 1, 2024Updated last year
- [CVPR 2025] VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?☆30May 10, 2025Updated last year
- [AAAI 2025] Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding☆34Mar 21, 2025Updated last year
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆23Nov 20, 2023Updated 2 years ago
- ☆13Aug 13, 2023Updated 2 years ago
- [ECCV 2024 Oral] Audio-Synchronized Visual Animation☆61Mar 15, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Download scripts and tools for Replay dataset.☆38Jun 23, 2023Updated 2 years ago
- ☆12Nov 1, 2024Updated last year
- Semantic Object Prediction and Spatial Sound Super-Resolution with Binaural Sounds☆20Dec 18, 2021Updated 4 years ago
- [CVPR 2025] Pytorch implementation of the paper "Hearing Anywhere in Any Environment"☆33Sep 18, 2025Updated 8 months ago
- The implementation of g2pL with a new open dataset.☆16May 14, 2023Updated 3 years ago
- Code for Deep Multimodal Clustering for Unsupervised Audiovisual Learning (CVPR2019)☆15May 27, 2020Updated 6 years ago
- [Arxiv'25] DINO-Tok: Adapting DINO for Visual Tokenizers☆39Apr 11, 2026Updated last month
- Spatial Audio Generation☆117Mar 24, 2023Updated 3 years ago
- An open-source application for 3D acoustic simulation☆82May 5, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code for paper Learning Audio-Visual Dereverberation☆32Aug 10, 2022Updated 3 years ago
- This dataset is presented in the paper Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video…☆12Sep 21, 2022Updated 3 years ago
- [NeurIPS'24 splotlight] Official Repo for AcoustiX used in Acoustic volume rendering for neural impulse response fields.☆37Dec 15, 2025Updated 5 months ago
- ☆15Nov 11, 2024Updated last year
- Diffusion generation on Mesh toolbox☆24Feb 10, 2025Updated last year
- We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.☆92May 29, 2024Updated 2 years ago
- Code and model for paper <Mutual Information Maximization for Effective Lip Reading>☆19Sep 4, 2020Updated 5 years ago
- ☆121Jun 2, 2026Updated last week
- ☆34Apr 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆65Jul 2, 2025Updated 11 months ago
- A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple task…☆462Sep 29, 2023Updated 2 years ago
- Sample based concatenative synthesizer for the NSynth dataset. Render any MIDI (.mid) sequence with the notes of NSynth.☆12Oct 4, 2023Updated 2 years ago
- Event Relation in Text-to-Audio (TTA) Generation☆21Feb 26, 2025Updated last year
- Open repository of simulated Room Impulse Responses (RIR) accompanying the paper "Hearing Anywhere in Any Environment"☆79Aug 11, 2025Updated 9 months ago
- The LAP Challenge aims at advancing spatial audio technologies through the personalization of HRTFs.☆16Aug 12, 2025Updated 9 months ago
- This implementation is based on the SincAlignNet model from the paper 'Frequency-Based Alignment of EEG and Audio Signals Using Contrasti…☆14Jul 28, 2025Updated 10 months ago