marmot-xy / CMBS
cross modal background suppression for audio-visual event localization
☆35Updated 2 years ago
Alternatives and similar repositories for CMBS:
Users that are interested in CMBS are comparing it to the libraries listed below
- ☆14Updated last year
- Cross-Modal Relation-Aware Networks for Audio-Visual Event Localization， ACM MM 2020☆33Updated 4 years ago
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆16Updated last year
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆27Updated 5 months ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆95Updated last year
- MUSIC-AVQA, CVPR2022 (ORAL)☆72Updated 2 years ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆82Updated 5 months ago
- PyTorch code for "Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes" (CVPR, 2022…☆31Updated 6 months ago
- ☆22Updated 3 months ago
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆31Updated 2 years ago
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆61Updated 11 months ago
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆24Updated last year
- Official implementation for MGN☆20Updated 2 years ago
- [2023 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line☆27Updated last year
- Official implementation for AVGN☆34Updated last year
- [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"☆43Updated last year
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆14Updated 8 months ago
- Multi-Scale Attention for Audio Question Answering☆28Updated last year
- Localizing Visual Sounds the Hard Way☆78Updated 2 years ago
- [ACM MM 2022] MM_Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing☆12Updated 2 years ago
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆35Updated 2 years ago
- download the vggsound dataset☆19Updated 2 years ago
- [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line☆41Updated 2 years ago
- Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…☆14Updated 3 years ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆17Updated 3 months ago
- ☆12Updated 6 months ago
- [CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learnin…☆23Updated last year
- Code for CVPR 2021 paper Exploring Heterogeneous Clues for Weakly-Supervised Audio-Visual Video Parsing☆24Updated 3 years ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆18Updated last year
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆38Updated 5 months ago