[NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
β36Feb 15, 2024Updated 2 years ago
Alternatives and similar repositories for AV-NeRF
Users that are interested in AV-NeRF are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)β44Sep 10, 2025Updated 8 months ago
- [π IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound β¦β31Mar 30, 2026Updated last month
- [ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.β34Mar 11, 2026Updated 2 months ago
- Hearing Anything Anywhere Code Releaseβ51Nov 11, 2025Updated 6 months ago
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmarkβ61Aug 29, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)β164Jan 20, 2024Updated 2 years ago
- AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesisβ12Oct 3, 2024Updated last year
- [CVPR 2025 GMCV] Test-Time Frequency Scaling: Instant Frequency Control for Any Diffusion Modelβ56May 31, 2025Updated 11 months ago
- β24Nov 1, 2024Updated last year
- β20May 11, 2025Updated last year
- [CVPR 2025] VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?β30May 10, 2025Updated last year
- [AAAI 2025] Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understandingβ34Mar 21, 2025Updated last year
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)β23Nov 20, 2023Updated 2 years ago
- β13Aug 13, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ECCV 2024 Oral] Audio-Synchronized Visual Animationβ61Mar 15, 2026Updated 2 months ago
- The repository provides code for EgoMAN model and dataset creation scripts.β31Dec 31, 2025Updated 4 months ago
- Download scripts and tools for Replay dataset.β38Jun 23, 2023Updated 2 years ago
- β12Nov 1, 2024Updated last year
- Semantic Object Prediction and Spatial Sound Super-Resolution with Binaural Soundsβ20Dec 18, 2021Updated 4 years ago
- [CVPR 2025] Pytorch implementation of the paper "Hearing Anywhere in Any Environment"β33Sep 18, 2025Updated 8 months ago
- The implementation of g2pL with a new open dataset.β16May 14, 2023Updated 3 years ago
- Code for Deep Multimodal Clustering for Unsupervised Audiovisual Learning (CVPR2019)β15May 27, 2020Updated 5 years ago
- [Arxiv'25] DINO-Tok: Adapting DINO for Visual Tokenizersβ38Apr 11, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available β’ AdRun AI, ML, and HPC workloads on powerful cloud GPUsβwithout limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Spatial Audio Generationβ117Mar 24, 2023Updated 3 years ago
- An open-source application for 3D acoustic simulationβ80May 5, 2026Updated 2 weeks ago
- Code for paper Learning Audio-Visual Dereverberationβ31Aug 10, 2022Updated 3 years ago
- This dataset is presented in the paper Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Videoβ¦β12Sep 21, 2022Updated 3 years ago
- [NeurIPS'24 splotlight] Official Repo for AcoustiX used in Acoustic volume rendering for neural impulse response fields.β37Dec 15, 2025Updated 5 months ago
- [CVPR 2023] Egocentric Audio-Visual Object Localizationβ26Jan 6, 2024Updated 2 years ago
- β15Nov 11, 2024Updated last year
- Diffusion generation on Mesh toolboxβ23Feb 10, 2025Updated last year
- [Neurips'24 and 25] "Acoustic Volume Rendering for Neural Impulse Response Fields" and "Resounding Acoustic Fields With Reciprocity"β81Dec 18, 2025Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting β’ AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.β91May 29, 2024Updated last year
- β120May 5, 2026Updated 2 weeks ago
- Code and model for paper <Mutual Information Maximization for Effective Lip Reading>β19Sep 4, 2020Updated 5 years ago
- β34Apr 10, 2023Updated 3 years ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationβ63Jul 2, 2025Updated 10 months ago
- A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple taskβ¦β456Sep 29, 2023Updated 2 years ago
- Event Relation in Text-to-Audio (TTA) Generationβ21Feb 26, 2025Updated last year