AmandineBtto / NeRAF
[ICLR 2025] NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
☆18Updated last month
Alternatives and similar repositories for NeRAF:
Users that are interested in NeRAF are comparing it to the libraries listed below
- AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis☆10Updated 5 months ago
- Hearing Anything Anywhere Code Release☆37Updated 9 months ago
- Code for Novel View Acoustic Synthesis paper☆45Updated last year
- ☆47Updated 8 months ago
- [Neurips'24 Spotlight] Official code for "Acoustic Volume Rendering for Neural Impulse Response Fields"☆31Updated 2 months ago
- ☆24Updated last year
- A large-scale real-world audio-visual dataset for research on 3D scene understanding and echolocation.☆13Updated last year
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)☆138Updated last year
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆37Updated last year
- Official code of AAAI'23 paper AudioEar: Single-View Ear Reconstruction for Personalized Spatial Audio written in PyTorch☆31Updated last year
- Download scripts and tools for Replay dataset.☆31Updated last year
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆43Updated 7 months ago
- [CVPR 2024] 3DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surfaces☆26Updated last year
- [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis☆27Updated last year
- Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos☆21Updated 6 months ago
- We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.☆84Updated 10 months ago
- NeRF Revisited: Fixing Quadrature Instability in Volume Rendering, Neurips 2023☆75Updated last year
- The official implementation of the IJCAI 2024 paper "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models".☆41Updated 6 months ago
- ☆38Updated 3 years ago
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆17Updated last year
- ☆15Updated 11 months ago
- Audio propagation engine - Meta Reality Labs Research.☆18Updated 2 years ago
- Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)☆65Updated 3 years ago
- ☆15Updated last year
- [NeurIPS'24 splotlight] Official Repo for AcoustiX used in Acoustic volume rendering for neural impulse response fields.☆18Updated 3 weeks ago
- Code for "Accurate Differential Operators for Hybrid Neural Fields"☆26Updated last year
- ☆45Updated 8 months ago
- Optimal-State Dynamics Estimation for Physics-based Human Motion Capture from Videos☆11Updated last month
- Semantic Object Prediction and Spatial Sound Super-Resolution with Binaural Sounds☆20Updated 3 years ago
- Code for the Paper: [ECCV2022] Sound Localization by Self-Supervised Time-Delay Estimation☆20Updated 2 years ago