swimmiing / ACL-SSL
Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"
☆15Updated last month
Alternatives and similar repositories for ACL-SSL:
Users that are interested in ACL-SSL are comparing it to the libraries listed below
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆17Updated 2 years ago
- [CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learnin…☆24Updated last year
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)☆9Updated last year
- ☆30Updated 3 weeks ago
- ☆20Updated last year
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆33Updated 2 years ago
- Official implementation for AVGN☆34Updated 2 years ago
- Baseline method for audio-visual sound event localization and detection task of DCASE 2023 challenge☆51Updated last week
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆46Updated last month
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆30Updated 7 months ago
- Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…☆32Updated last year
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆24Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆54Updated 3 years ago
- Full-frequency dynamic convolution: a physical frequency-dependent convolution for sound event detection☆16Updated 7 months ago
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆17Updated last year
- ☆40Updated 2 years ago
- PyTorch code for "Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes" (CVPR, 2022…☆32Updated 8 months ago
- ☆13Updated 9 months ago
- Audio-Visual Generalized Zero-Shot Learning using Large Pre-Trained Models☆14Updated 11 months ago
- Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"☆29Updated 5 months ago
- Official implementation for MGN☆20Updated 2 years ago
- Official Repository for "Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization" (ACM MM 2023)☆14Updated last year
- ☆21Updated 6 months ago
- [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation☆34Updated 6 months ago
- Repository for the 2023 WACV paper: "Hear The Flow: Optical Flow-Based Self-Supervised Visual Sound Source Localization"☆11Updated 2 years ago
- Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation☆24Updated 3 years ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆19Updated 6 months ago
- [CVPR 2024 Highlight] Official implementation of the paper: Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-…☆39Updated 8 months ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year
- PyTorch implementation of "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scorin…☆15Updated 11 months ago