ubc-vision / TriBERT
Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS 2021
☆14Updated 3 years ago
Alternatives and similar repositories for TriBERT:
Users that are interested in TriBERT are comparing it to the libraries listed below
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆32Updated 2 years ago
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆17Updated 2 years ago
- Official implementation for AVGN☆34Updated last year
- cross modal background suppression for audio-visual event localization☆35Updated 2 years ago
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆24Updated last year
- Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation☆24Updated 3 years ago
- Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…☆32Updated last year
- ☆16Updated last year
- Code for CVPR 2021 paper Exploring Heterogeneous Clues for Weakly-Supervised Audio-Visual Video Parsing☆24Updated 3 years ago
- ☆46Updated 2 years ago
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆15Updated 3 weeks ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆99Updated last year
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)☆9Updated last year
- PyTorch implementation of "Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video" (ICCV2021)☆20Updated 2 years ago
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆18Updated last year
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆84Updated 7 months ago
- ☆28Updated 2 years ago
- Source code for the paper 'Audio Captioning Transformer'☆53Updated 3 years ago
- Localizing Visual Sounds the Hard Way☆78Updated 2 years ago
- Official implementation for MGN☆20Updated 2 years ago
- PyTorch code for "Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes" (CVPR, 2022…☆32Updated 8 months ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆51Updated 2 years ago
- ☆20Updated 11 months ago
- ☆20Updated 5 months ago
- Code for Discriminative Sounding Objects Localization (NeurIPS 2020)☆57Updated 3 years ago
- ☆14Updated last year
- [CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learnin…☆24Updated last year
- Co-Separating Sounds of Visual Objects (ICCV 2019)☆94Updated last year
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆30Updated 7 months ago
- [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line☆41Updated 2 years ago