stoneMo / DeepAVFusion
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
☆30Updated 7 months ago
Alternatives and similar repositories for DeepAVFusion:
Users that are interested in DeepAVFusion are comparing it to the libraries listed below
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆62Updated last week
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆99Updated last year
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆39Updated 7 months ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆28Updated 5 months ago
- ☆12Updated 8 months ago
- ☆25Updated 5 months ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆39Updated 4 months ago
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆32Updated 2 years ago
- ☆20Updated 11 months ago
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆18Updated last year
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆15Updated 4 months ago
- NeurIPS'2023 official implementation code☆60Updated last year
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆51Updated 6 months ago
- [CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learnin…☆24Updated last year
- [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"☆47Updated last month
- Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024☆17Updated 11 months ago
- ☆14Updated last year
- cross modal background suppression for audio-visual event localization☆35Updated 3 years ago
- Official implementation for AVGN☆34Updated last year
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆62Updated last year
- [2023 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line☆29Updated 2 years ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆19Updated 6 months ago
- Official implementation for MGN☆20Updated 2 years ago
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆17Updated 2 years ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆78Updated 2 years ago
- ☆21Updated 5 months ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆19Updated last year
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆15Updated 3 weeks ago
- [ACM MM 2022] MM_Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing☆13Updated 2 years ago