Franklin905 / VALOR
Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"
☆15Updated last year
Related projects ⓘ
Alternatives and complementary repositories for VALOR
- ☆13Updated last year
- cross modal background suppression for audio-visual event localization☆35Updated 2 years ago
- Official implementation for MGN☆20Updated last year
- ☆18Updated last month
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆61Updated 9 months ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆26Updated last month
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆23Updated 10 months ago
- [2023 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line☆26Updated last year
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆89Updated last year
- MUSIC-AVQA, CVPR2022 (ORAL)☆67Updated last year
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆30Updated 2 years ago
- ☆10Updated 5 months ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆21Updated 3 months ago
- ☆21Updated last month
- Multi-Scale Attention for Audio Question Answering☆27Updated last year
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆14Updated 3 weeks ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆80Updated 3 months ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆37Updated 2 weeks ago
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆34Updated last year
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆35Updated 3 months ago
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆14Updated 6 months ago
- ☆19Updated last month
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆18Updated last year
- [ACM MM 2022] MM_Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing☆12Updated 2 years ago
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆16Updated last year
- [CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learnin…☆23Updated last year
- Official repository of PanoAVQA: Grounded Audio-Visual Question Answering in 360° Videos (ICCV 2021)☆13Updated 3 years ago
- Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…☆14Updated 2 years ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆41Updated 2 months ago
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆56Updated 7 months ago