haoyi-duan / DG-SCT
NeurIPS'2023 official implementation code
☆62Updated last year
Alternatives and similar repositories for DG-SCT:
Users that are interested in DG-SCT are comparing it to the libraries listed below
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆99Updated last year
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆39Updated 3 weeks ago
- ☆28Updated 7 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆52Updated 8 months ago
- ☆43Updated 2 weeks ago
- Towards Long Form Audio-visual Video Understanding☆14Updated 2 weeks ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆29Updated 7 months ago
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆66Updated 2 months ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆40Updated 6 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated 9 months ago
- Unified Audio-Visual Perception for Multi-Task Video Localization☆24Updated last year
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆16Updated 6 months ago
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆96Updated 6 months ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆31Updated 9 months ago
- Official PyTorch repository for GRAM☆58Updated this week
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆63Updated last year
- Official implementation for CIGN☆15Updated last year
- The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024☆39Updated 5 months ago
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆43Updated 3 months ago
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆20Updated 3 weeks ago
- Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024☆20Updated last year
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆24Updated 4 months ago
- ☆22Updated 7 months ago
- ☆32Updated last year
- MUSIC-AVQA, CVPR2022 (ORAL)☆85Updated 2 years ago
- ☆19Updated last month
- PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"☆20Updated 6 months ago
- Multi-Scale Attention for Audio Question Answering☆28Updated last year
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆36Updated 2 years ago
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆59Updated this week