GenjiB / LAVISH
Vision Transformers are Parameter-Efficient Audio-Visual Learners
☆96Updated last year
Alternatives and similar repositories for LAVISH:
Users that are interested in LAVISH are comparing it to the libraries listed below
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆60Updated last month
- MUSIC-AVQA, CVPR2022 (ORAL)☆73Updated 2 years ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆27Updated 5 months ago
- ☆23Updated 3 months ago
- Official implementation for MGN☆20Updated 2 years ago
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆35Updated 2 years ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆28Updated 3 months ago
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆31Updated 2 years ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆82Updated 6 months ago
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆38Updated 6 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆48Updated 4 months ago
- ☆14Updated 3 years ago
- [ACM MM 2022] MM_Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing☆12Updated 2 years ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆38Updated 2 months ago
- ☆14Updated last year
- ☆20Updated 4 months ago
- Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation☆25Updated 3 years ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆18Updated last year
- The repo for "Class-aware Sounding Objects Localization", TPAMI 2021.☆29Updated 2 years ago
- Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024☆16Updated 10 months ago
- NeurIPS'2023 official implementation code☆59Updated last year
- Multi-Scale Attention for Audio Question Answering☆28Updated last year
- cross modal background suppression for audio-visual event localization☆35Updated 2 years ago
- ☆20Updated 10 months ago
- ☆12Updated 7 months ago
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆16Updated last year
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆17Updated 4 months ago
- Code for CVPR2023 paper "Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies"☆17Updated last year
- ☆31Updated 10 months ago
- Official implementation for AVGN☆34Updated last year