vvvb-github / AVSegFormer
[AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer
☆52Updated 5 months ago
Related projects: ⓘ
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆31Updated last month
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆82Updated last year
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆21Updated last week
- Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024☆13Updated 5 months ago
- The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024☆20Updated last month
- [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training☆66Updated last year
- [CVPR 2024] "Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition"☆11Updated 6 months ago
- Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"☆35Updated 3 weeks ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆16Updated last month
- ☆19Updated 9 months ago
- The official repository for ICLR2024 paper "FROSTER: Frozen CLIP is a Strong Teacher for Open-Vocabulary Action Recognition"☆55Updated 5 months ago
- ☆45Updated last year
- ☆17Updated 6 months ago
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆33Updated last year
- [CVPR 2023]Implementation of Siamese Image Modeling for Self-Supervised Vision Representation Learning☆33Updated 3 months ago
- [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction☆41Updated last year
- The official repo for "Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation", ECCV 2024☆9Updated last week
- Wnet: Audio-Guided Video Object Segmentation via Wavelet-Based Cross-Modal Denoising Networks☆21Updated 2 years ago
- [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions☆59Updated 4 months ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆17Updated last year
- ☆12Updated 2 months ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆25Updated 2 months ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆16Updated 11 months ago
- Accepted at ICCV '23☆13Updated 11 months ago
- [NeurIPS 2022] code for the paper, SemMAE: Semantic-guided masking for learning masked autoencoders☆32Updated last year
- Official PyTorch implementation of CVPR2022 paper “Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled Data”☆13Updated 2 years ago
- ☆51Updated 2 years ago
- The official implementation for Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection (DiffOOD)☆41Updated last year
- [CVPR 2023] Official repository for paper "Stare at What You See: Masked Image Modeling without Reconstruction"☆63Updated 9 months ago
- ☆12Updated 9 months ago