Offical code for the CVPR 2024 Paper: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
☆91Jun 12, 2024Updated 2 years ago
Alternatives and similar repositories for DenseAV
Users that are interested in DenseAV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR25] Official Implementation of CAV-MAE Sync☆37Apr 5, 2026Updated 7 months ago
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆43Oct 2, 2022Updated 4 years ago
- Siamese Vision Transformers are Scalable Audio-visual Learners☆14Apr 1, 2024Updated 2 years ago
- Training and evaluation code for our paper "MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learnin…☆25Oct 29, 2026Updated 3 weeks ago
- ☆15Jan 24, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Question-Aware Gaussian Experts for Audio-Visual Question Answering -- Official Pytorch Implementation (CVPR'25, Highlight)☆31Jun 6, 2025Updated last year
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆22Dec 6, 2022Updated 3 years ago
- Official repository for the paper "Topological Neural Discrete Representation Learning à la Kohonen" (ICML 2023 Workshop on Sampling and …☆13Jun 11, 2025Updated last year
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆38Feb 11, 2026Updated 9 months ago
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)☆12Jun 1, 2023Updated 3 years ago
- [ICASSP 2024] Max-AST: Combining Convolution, Local and Global Self-Attentions for Audio Event Classification☆13Mar 10, 2025Updated last year
- VGGSounder, a multi-label audio-visual classification dataset with modality annotations.☆19Jun 30, 2026Updated 4 months ago
- Implementation of VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generation (CVPR'25)☆14Jun 13, 2026Updated 5 months ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆28Aug 30, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- VAESSL: Train a computer to locate acoustic sources in reverberant environments with only few labels, using semi-supervised learning with…☆11Jul 26, 2021Updated 5 years ago
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆44Jul 16, 2026Updated 4 months ago
- code for A Large-scale Dataset for Audio-Language Representation Learning☆14Sep 18, 2024Updated 2 years ago
- [NeurIPS 2023] AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis☆36Feb 15, 2024Updated 2 years ago
- Unsupervised spoken sentence embeddings☆14Dec 14, 2022Updated 3 years ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆139Sep 15, 2025Updated last year
- Localizing Visual Sounds the Hard Way☆84Jul 6, 2022Updated 4 years ago
- Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024☆28Mar 14, 2026Updated 8 months ago
- Code for Deep Multimodal Clustering for Unsupervised Audiovisual Learning (CVPR2019)☆15May 27, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Towards Efficient Audio-Visual Learners via Empowering Pre-trained Vision Transformers with Cross-Modal Adaptation☆15Apr 13, 2024Updated 2 years ago
- Repository for the 2023 WACV paper: "Hear The Flow: Optical Flow-Based Self-Supervised Visual Sound Source Localization"☆12Dec 21, 2022Updated 3 years ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆38Oct 11, 2024Updated 2 years ago
- GitHub repository for AudioToolAgent☆22Feb 13, 2026Updated 9 months ago
- Code and data recipes for the paper: Optimal Condition Training for Target Source Separation by Efthymios Tzinis, Gordon Wichern, Paris S…☆14Feb 15, 2023Updated 3 years ago
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆154Jul 6, 2024Updated 2 years ago
- ☆18Oct 2, 2023Updated 3 years ago
- [NeurIPS 2024] AV-Cloud: Spatial Audio Rendering Through Audio-Visual Cloud Splatting☆16Nov 22, 2025Updated 11 months ago
- An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.☆10Feb 22, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation☆41Nov 20, 2024Updated last year
- Visual Grounding for Object-Level Generalization in Reinforcement Learning (ECCV 2024)☆10Oct 17, 2024Updated 2 years ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆77Dec 3, 2025Updated 11 months ago
- Official repo for SAO-Instruct: Free-form Audio Editing using Natural Language Instructions presented at NeurIPS 2025☆23Oct 28, 2025Updated last year
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆57Jan 29, 2024Updated 2 years ago
- ☆14Nov 22, 2022Updated 3 years ago
- Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Grounding, ECCV 2024☆11Jan 8, 2025Updated last year
Are these results useful?