AmandineBtto / NeRAF
NeRAF jointly learns acoustic and radiance fields, enabling realistic audio-visual generation.
☆11Updated last week
Related projects ⓘ
Alternatives and complementary repositories for NeRAF
- A large-scale real-world audio-visual dataset for research on 3D scene understanding and echolocation.☆10Updated 7 months ago
- ☆22Updated last year
- Code for Novel View Acoustic Synthesis paper☆44Updated last year
- Official code for "Learning Neural Acoustic Fields" (NeurIPS 2022)☆129Updated 9 months ago
- ☆46Updated 3 months ago
- Hearing Anything Anywhere Code Release☆28Updated 5 months ago
- ☆44Updated 4 months ago
- Download scripts and tools for Replay dataset.☆30Updated last year
- Real Acoustic Fields An Audio-Visual Room Acoustics Dataset and Benchmark☆37Updated 2 months ago
- [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis☆22Updated 8 months ago
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆35Updated 10 months ago
- We present a model that can generate accurate 3D sound fields of human bodies from headset microphones and body pose as inputs.☆83Updated 5 months ago
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆14Updated 11 months ago
- Code and datasets for 'Move2Hear: Active Audio-Visual Source Separation' (ICCV 2021)☆13Updated last year
- [CVPR 2024] 3DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surfaces☆20Updated 7 months ago
- This is the official implementation of our mesh-based neural network (MESH2IR) to generate acoustic impulse responses (IRs) for indoor 3D…☆80Updated 3 months ago
- Official code of AAAI'23 paper AudioEar: Single-View Ear Reconstruction for Personalized Spatial Audio written in PyTorch☆29Updated 10 months ago
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆103Updated 2 years ago
- Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)☆62Updated 3 years ago
- Repo for Visual Acoustic Matching, CVPR 2022☆64Updated last year
- Localize to Binauralize: Audio Spatialization from Visual Sound Source Localization (ICCV 2021)☆9Updated 3 years ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆13Updated 3 weeks ago
- Audio propagation engine - Meta Reality Labs Research.☆17Updated 2 years ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆37Updated last year
- Code for paper Learning Audio-Visual Dereverberation☆26Updated 2 years ago
- Agent-to-Sim Learning Interactive Behavior from Casual Videos.☆31Updated 3 weeks ago
- [CVPR 2023] iQuery: Instruments as Queries for Audio-Visual Sound Separation☆62Updated last year
- A machine learning framework for reconstructing articulated 3D animals from images☆73Updated this week
- Code for the Paper: [ECCV2022] Sound Localization by Self-Supervised Time-Delay Estimation☆19Updated last year
- Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)☆68Updated 4 years ago