rikeilong / Bay-CAT
[ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
☆51Updated 6 months ago
Alternatives and similar repositories for Bay-CAT:
Users that are interested in Bay-CAT are comparing it to the libraries listed below
- ☆25Updated 5 months ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆39Updated 4 months ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆99Updated last year
- [CVPR 2024] Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection☆86Updated 8 months ago
- [CVPR 2024] Context-Guided Spatio-Temporal Video Grounding☆51Updated 8 months ago
- [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"☆32Updated last year
- [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer☆62Updated last week
- 🌀 R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding (ECCV 2024)☆80Updated 8 months ago
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆94Updated 4 months ago
- [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval☆53Updated 8 months ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆28Updated 5 months ago
- Pytorch Code for "Unified Coarse-to-Fine Alignment for Video-Text Retrieval" (ICCV 2023)☆63Updated 9 months ago
- Official PyTorch code of GroundVQA (CVPR'24)☆56Updated 6 months ago
- Unified Audio-Visual Perception for Multi-Task Video Localization☆24Updated 11 months ago
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆15Updated 4 months ago
- Official Implementation of "Chrono: A Simple Blueprint for Representing Time in MLLMs"☆81Updated last week
- ☆32Updated last year
- Official implementation of "HowToCaption: Prompting LLMs to Transform Video Annotations at Scale." ECCV 2024☆51Updated 5 months ago
- Official pytorch repository for "Knowing Where to Focus: Event-aware Transformer for Video Grounding" (ICCV 2023)☆50Updated last year
- Code for "Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations" (CVPR 2024 Oral)☆13Updated 8 months ago
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆62Updated last year
- The official repository for paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".☆33Updated last month
- NeurIPS'2023 official implementation code☆60Updated last year
- ☆23Updated 5 months ago
- ICCV2023: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning☆41Updated last year
- ☆32Updated 6 months ago
- [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.☆39Updated 5 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆107Updated 3 weeks ago
- Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Gr…☆127Updated 6 months ago
- Code implementation of paper "MUSE: Mamba is Efficient Multi-scale Learner for Text-video Retrieval (AAAI2025)"☆18Updated last month