ttgeng233 / UniAV
Unified Audio-Visual Perception for Multi-Task Video Localization
☆15Updated 5 months ago
Related projects: ⓘ
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆54Updated 7 months ago
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆15Updated 11 months ago
- NeurIPS'2023 official implementation code☆53Updated 10 months ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆35Updated 3 weeks ago
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆85Updated last month
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆21Updated last week
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆82Updated last year
- [ICCV 2023] Accurate and Fast Compressed Video Captioning☆33Updated 7 months ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆17Updated last year
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆37Updated 2 weeks ago
- [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"☆24Updated 7 months ago
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆11Updated last month
- ☆13Updated 10 months ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆16Updated last month
- [CVPR 2024] Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection☆66Updated 2 months ago
- The official implementation of AdaTAD: End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames☆30Updated 2 months ago
- [ACM MM 2022] MM_Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing☆12Updated 2 years ago
- Pytorch Code for "Unified Coarse-to-Fine Alignment for Video-Text Retrieval" (ICCV 2023)☆50Updated 3 months ago
- ☆12Updated 2 months ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆66Updated last year
- Official pytorch repository for "Knowing Where to Focus: Event-aware Transformer for Video Grounding" (ICCV 2023)☆46Updated last year
- [2023 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line☆22Updated last year
- The official code of Towards Balanced Alignment: Modal-Enhanced Semantic Modeling for Video Moment Retrieval (AAAI2024)☆28Updated 5 months ago
- [CVPR 2024] Context-Guided Spatio-Temporal Video Grounding☆38Updated 2 months ago
- Official implementation of "Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval (CVPR 2024 Highlight)"☆44Updated last month
- ☆16Updated last year
- Official Implementation of "Open-Vocabulary Audio-Visual Semantic Segmentation" [ACM MM 2024 Oral].☆11Updated last month
- [IJCAI 2023] Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment☆44Updated 5 months ago
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆23Updated 8 months ago
- Code for the paper, Temporal Action Localization with Enhanced Instant Discriminability☆20Updated 5 months ago