[CVPR 2025] Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperation
☆80Dec 24, 2025Updated 2 months ago
Alternatives and similar repositories for Crab
Users that are interested in Crab are comparing it to the libraries listed below
Sorting:
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆16Oct 25, 2024Updated last year
- [2025 CVPR] Towards Open-Vocabulary Audio-Visual Event Localization☆41Mar 7, 2025Updated 11 months ago
- ☆36Jul 9, 2025Updated 7 months ago
- Official Implementation of "Open-Vocabulary Audio-Visual Semantic Segmentation" [ACM MM 2024 Oral].☆35Nov 2, 2024Updated last year
- ACM MM 2022 paper_AVQA: A Dataset for Audio-Visual Question Answering on Videos☆16Aug 17, 2023Updated 2 years ago
- [CVPR 2025] 🔥 Official impl. of "Audio-Visual Instance Segmentation".☆42Jun 5, 2025Updated 8 months ago
- [2026 AAAI] Think Before You Segment: An Object-aware Reasoning Agent for Referring Audio-Visual Segmentation☆19Nov 8, 2025Updated 3 months ago
- ☆17Aug 11, 2023Updated 2 years ago
- The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024☆50Oct 12, 2025Updated 4 months ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆96Dec 30, 2022Updated 3 years ago
- Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)☆16Mar 17, 2025Updated 11 months ago
- All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignment☆19Feb 11, 2025Updated last year
- The offical repo for "Play to the Score: Stage-Guided Dynamic Multi-Sensory Fusion for Robotic Manipulation", CoRL 2024 (ORAL)☆19Jun 25, 2025Updated 8 months ago
- ☆17Apr 9, 2025Updated 10 months ago
- ☆14Nov 13, 2023Updated 2 years ago
- WildVSR☆21Dec 13, 2023Updated 2 years ago
- [AAAI 2026] SIFThinker: Spatially-Aware Image Focus for Visual Reasoning☆23Dec 2, 2025Updated 3 months ago
- ☆16Apr 4, 2025Updated 10 months ago
- Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation (TIP 2024, ACM MM 2023)☆19Mar 13, 2024Updated last year
- ☆18Nov 15, 2024Updated last year
- The official repo for "Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation", ECCV 2024☆18Oct 11, 2024Updated last year
- A curated list of audio-visual learning methods and datasets.☆286Dec 3, 2024Updated last year
- [CVPR 2025] iSegMan: Interactive Segment-and-Manipulate 3D Gaussians 🔥🔥🔥☆24Mar 12, 2025Updated 11 months ago
- Towards Long Form Audio-visual Video Understanding☆15Jan 16, 2026Updated last month
- WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoning (CVPR 2026)☆55Dec 30, 2025Updated 2 months ago
- Question-Aware Gaussian Experts for Audio-Visual Question Answering -- Official Pytorch Implementation (CVPR'25, Highlight)☆26Jun 6, 2025Updated 8 months ago
- Official implementation of paper "OED: Towards One-stage End-to-End Dynamic Scene Graph Generation".☆26Mar 26, 2024Updated last year
- Training recipe for SpatialReasoner☆38Sep 21, 2025Updated 5 months ago
- The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)☆310Sep 22, 2025Updated 5 months ago
- Learning Better Video Query with SAM for Video Instance Segmentation (TCSVT 2024)☆26Apr 2, 2024Updated last year
- Unified Audio-Visual Perception for Multi-Task Video Localization☆30Apr 19, 2024Updated last year
- Multi-Scale Attention for Audio Question Answering☆28Jul 19, 2023Updated 2 years ago
- OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆55Feb 1, 2026Updated last month
- [CVPR 2024 Highlight] Official GraCo: Granularity-Controllable Interactive Segmentation.☆62Mar 11, 2025Updated 11 months ago
- ☆39Aug 26, 2025Updated 6 months ago
- Offical implemention of the paper DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction☆29May 26, 2024Updated last year
- Official code for "A Closer Look at Audio-Visual Segmentation"☆94Oct 31, 2025Updated 4 months ago
- [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval☆64Jun 19, 2024Updated last year
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆70Jan 4, 2026Updated last month