ExplainableML / AVCA-GZSL
This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and Language"
☆33Updated last year
Related projects: ⓘ
- This repository contains the code for our ECCV 2022 paper "Temporal and cross-modal attention for audio-visual zero-shot learning"☆24Updated last year
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆82Updated last year
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆77Updated last month
- Official implementation for MGN☆20Updated last year
- MUSIC-AVQA, CVPR2022 (ORAL)☆66Updated last year
- ☆19Updated 9 months ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆17Updated last year
- ☆51Updated 2 years ago
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆29Updated last year
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆86Updated 3 years ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆35Updated 3 weeks ago
- ☆31Updated 2 years ago
- [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line☆39Updated 2 years ago
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆23Updated 8 months ago
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆68Updated 7 months ago
- Multi-Scale Attention for Audio Question Answering☆24Updated last year
- ☆17Updated 6 months ago
- ☆30Updated last year
- Self-Supervised Learning by Cross-Modal Audio-Video Clustering (NeurIPS 2020)☆90Updated last year
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆49Updated 2 years ago
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆52Updated 5 months ago
- CVPR2022☆20Updated 2 years ago
- ☆13Updated 10 months ago
- The repo for "Class-aware Sounding Objects Localization", TPAMI 2021.☆29Updated 2 years ago
- [ACM MM 2022] MM_Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing☆12Updated 2 years ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆37Updated 2 weeks ago
- Official Code of ECCV 2022 paper MS-CLIP☆83Updated 2 years ago
- PyTorch code for "Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes" (CVPR, 2022…☆30Updated 2 months ago
- ☆14Updated 2 years ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆16Updated last month