AmandineBtto / NeRAF
NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
☆11Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for NeRAF
- Code for Novel View Acoustic Synthesis paper☆44Updated last year
- A large-scale real-world audio-visual dataset for research on 3D scene understanding and echolocation.☆10Updated 8 months ago
- ☆22Updated last year
- Download scripts and tools for Replay dataset.☆30Updated last year
- ☆46Updated 4 months ago
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆35Updated 10 months ago
- Hearing Anything Anywhere Code Release☆28Updated 5 months ago
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆37Updated 2 months ago
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)☆130Updated 10 months ago
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆14Updated last year
- Repo for Visual Acoustic Matching, CVPR 2022☆65Updated last year
- ☆44Updated 4 months ago
- We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.☆83Updated 5 months ago
- NeRF Revisited: Fixing Quadrature Instability in Volume Rendering, Neurips 2023☆74Updated 10 months ago
- [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis☆22Updated 9 months ago
- [CVPR 2024] 3DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surfaces☆20Updated 7 months ago
- Audio propagation engine - Meta Reality Labs Research.☆17Updated 2 years ago
- This is the official implementation of our mesh-based neural network (MESH2IR) to generate acoustic impulse responses (IRs) for indoor 3D…☆82Updated 3 months ago
- High order Moment Models☆22Updated last week
- Code and datasets for 'Move2Hear: Active Audio-Visual Source Separation' (ICCV 2021)☆14Updated last year
- [CVPR 2023] iQuery: Instruments as Queries for Audio-Visual Sound Separation☆63Updated last year
- Official implementation of ViewFusion: Learning Composable Diffusion Models for Novel View Synthesis☆32Updated 7 months ago
- [ICLR'24] GTA: A Geometry-Aware Attention Mechanism for Multi-view Transformers☆120Updated 5 months ago
- Code for the Paper: [ECCV2022] Sound Localization by Self-Supervised Time-Delay Estimation☆19Updated last year
- Deep Learning on Object-centric 3D Neural Fields (TPAMI)☆13Updated 3 months ago
- Code for paper Learning Audio-Visual Dereverberation☆26Updated 2 years ago
- [ECCV 2022] Official code release of Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantification☆35Updated last year
- [NeurIPS 2021] Code for Learning Signal-Agnostic Manifolds of Neural Fields☆66Updated last year
- [IJCV 2024] MoDA: Modeling Deformable 3D Objects from Casual Videos☆31Updated this week
- Official Pytorch implementation of the "A Model You Can Hear: Audio Identification with Playable Prototypes" paper☆37Updated 2 years ago